SAWMILLFORUM

Sawmill System

Ubuntu 12.04 LTS with latest updates
Sawmill 8.6.1.3 - local compile
libmysqlclient-dev - 5.5.29-0ubuntu0.12.04.2

MySQL Server

RHEL 6.4 with latest updates x86_64 - 2.6.32-358.2.1 kernel
MySQL Server - mysql-server-5.1.67-1.el6_3.x86_64

When trying to use MySQL as the db for a profile, I get the following error once logfile processing has completed:

SQL query failed: 'LOAD DATA INFILE "/logs/sawmill/sql_load_data_9492_seq0.tsv" into table MediaSmrt_main_table (loadorder, db_filters_computed, date_time, bottomleveldate, day_of_week, hour_of_day, page, hostname, referrer, server_domain, authenticated_user, server_response, hits, `size`, wsp_file_type, uaa_web_browser, uaa_web_browser_major_version, uaa_web_browser_full_version, uaa_operating_system, uaa_spider, page_views, so_screen_dimensions, so_screen_depth, geo_country, geo_region, geo_city, geo_isp, geo_organization, geo_domain, wsp_worm, ref_search_engine, ref_search_phrase, device_category, mobile_device, session_id, session_sequence_number, session_entrances, session_exits, session_duration, broken_links_page, broken_links_referrer)' error=Lost connection to MySQL server during query at Sc32dd20b04e638c09f93855bd83e1aa5.cpp:594
Error occurred at: : Sad8bd8eb80df35cc286ed5e1900cc399.cpp:482 Error occurred in Salang at current_context:1

The tables are created in the database and records are inserted. The interesting thing is that I played with the "General Tuning" parameter "Number of rows of data to load per block" and found that small numbers produce a lot of files and they all get loaded in the MySQL db. When it hits the last block, it barfs with the above error pointing to block file number 3, always. When I increased the block size to 500 million rows (attempting to only have a single file to load) the file is created and command is sent to MySQL to load it. The load command shows up in the MySQL admin view but Sawmill spits out the above error. The error above is for the single giant file.

The connection does not show up on the Sawmill side as if the connection has been closed while the session continues on the MySQL side. Once the load is completed on the MySQL side, the session times out and is dropped leaving the data in the db. I'm not sure what is breaking down since the login configured for the db in Sawmill has very high privs, also an attempt to see if there was some form of permissions issue.

I haven't run into any issues using a MySQL client version of 5.5 against a 5.1 server with other applications so I'm not sure what may be causing this problem. Any help would be grateful.

Testing MySQL 5.5 on the Sawmill system to confirm the error on a consistent Client/Server release has resulted in a slightly different error.

SQL query failed: 'LOAD DATA INFILE "/logs/sawmill/sql_load_data_2214_seq0.tsv" into table Test_main_table (loadorder, db_filters_computed, date_time, bottomleveldate, day_of_week, hour_of_day, page, hostname, referrer, server_domain, authenticated_user, server_response, hits, `size`, wsp_file_type, uaa_web_browser, uaa_web_browser_major_version, uaa_web_browser_full_version, uaa_operating_system, uaa_spider, page_views, so_screen_dimensions, so_screen_depth, geo_country, geo_region, geo_city, geo_isp, geo_organization, geo_domain, wsp_worm, ref_search_engine, ref_search_phrase, device_category, device_type, session_id, session_sequence_number, session_entrances, session_exits, session_duration, broken_links_page, broken_links_referrer)' error=File '/logs/sawmill/sql_load_data_2214_seq0.tsv' not found (Errcode: 13) at Sc32dd20b04e638c09f93855bd83e1aa5.cpp:594
Error occurred at: : Sad8bd8eb80df35cc286ed5e1900cc399.cpp:482 Error occurred in Salang at current_context:1

The file is there and at least with read permissions for everyone. This happens on the first file regardless of block size and never loads data into the MySQL db.

Cheers,

Cheers,