Title:
Bug 72679:While indexing about 10,000 records from a query the indexing process stopped without error
| View in TrackerStatus/Resolution/Reason: Closed/Withdrawn/
Reporter/Name(from Bugbase): Dave Ferguson / Dave Ferguson (dave_jf)
Created: 08/14/2008
Components: Text Search, Solr
Versions: 9.0
Failure Type: Unspecified
Found In Build/Fixed In Build: 0000 /
Priority/Frequency: Trivial / Unknown
Locale/System: English / Win All
Vote Count: 0
Problem:
While indexing about 10,000 records from a query the indexing process stopped without error. Any attempts to update that index fail with a coldfusion error of "an error occurred while indexing a Lucene collection". Creating a new collection after this happens and then trying to index the new collection throws same error. Digging through the logs I found a out of memory error in the coldfusion-event.log file.
Cycling the coldfusion service does not clear the issue. After CF restart the memory error is gone but still unable to index. This error was found in the coldfusion-out.log "08/14 06:35:03 Error [web-0] - There were problems performing the index operation.An error occurred while indexing a Lucene collection. The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 12"
A reboot of the server did not fix it either.
Method:
CODE:
<CFQUERY NAME="getData" DATASOURCE="myDSN">
select top 10000 af.file_id, af.asset_name,af.original_file_name asset_description From asset_files af
join assets_addl_info aai
on aai.file_id = af.file_id
</CFQUERY>
<CFINDEX ACTION="UPDATE" COLLECTION="testcollection2" QUERY="getData" TYPE="CUSTOM" KEY="file_id" TITLE="assets" BODY="asset_name,original_file_name,asset_description">
Result:
INITIAL ERROR:
08/13 09:45:28 error ROOT CAUSE:
java.lang.OutOfMemoryError: Java heap space
at macromedia.util.UtilTransliteratorUsingTable.decode(Unknown Source)
at macromedia.jdbc.sqlserver.SQLServerByteOrderedDataReader.readString(Unknown Source)
at macromedia.jdbc.sqlserver.tds.TDSRequest.getReturnedValue(Unknown Source)
at macromedia.jdbc.sqlserver.tds.TDSRequest.getColumnDataForRow(Unknown Source)
at macromedia.jdbc.sqlserver.SQLServerImplResultSet.getData(Unknown Source)
at macromedia.jdbc.base.BaseResultSet.getString(Unknown Source)
at coldfusion.sql.QueryTable.populate(QueryTable.java:333)
at coldfusion.sql.QueryTable.populate(QueryTable.java:243)
at coldfusion.sql.Executive.getRowSet(Executive.java:466)
at coldfusion.sql.Executive.executeQuery(Executive.java:1252)
at coldfusion.sql.Executive.executeQuery(Executive.java:1008)
at coldfusion.sql.Executive.executeQuery(Executive.java:939)
at coldfusion.sql.SqlImpl.execute(SqlImpl.java:325)
at coldfusion.tagext.sql.QueryTag.executeQuery(QueryTag.java:831)
at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:521)
at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:4)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
at coldfusion.CfmServlet.service(CfmServlet.java:177)
"Error","web-19","08/13/08","09:45:28",,"Java heap space The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 4 "
java.lang.OutOfMemoryError: Java heap space
at macromedia.util.UtilTransliteratorUsingTable.decode(Unknown Source)
at macromedia.jdbc.sqlserver.SQLServerByteOrderedDataReader.readString(Unknown Source)
at macromedia.jdbc.sqlserver.tds.TDSRequest.getReturnedValue(Unknown Source)
at macromedia.jdbc.sqlserver.tds.TDSRequest.getColumnDataForRow(Unknown Source)
at macromedia.jdbc.sqlserver.SQLServerImplResultSet.getData(Unknown Source)
at macromedia.jdbc.base.BaseResultSet.getString(Unknown Source)
at coldfusion.sql.QueryTable.populate(QueryTable.java:333)
at coldfusion.sql.QueryTable.populate(QueryTable.java:243)
at coldfusion.sql.Executive.getRowSet(Executive.java:466)
at coldfusion.sql.Executive.executeQuery(Executive.java:1252)
at coldfusion.sql.Executive.executeQuery(Executive.java:1008)
at coldfusion.sql.Executive.executeQuery(Executive.java:939)
at coldfusion.sql.SqlImpl.execute(SqlImpl.java:325)
at coldfusion.tagext.sql.QueryTag.executeQuery(QueryTag.java:831)
at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:521)
at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:4)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
at coldfusion.CfmServlet.service(CfmServlet.java:177)
ERROR AFTER REBOOT:
"Error","web-0","08/14/08","06:38:26",,"There were problems performing the index operation.An error occurred while indexing a Lucene collection. The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 12 "
coldfusion.tagext.search.IndexTag$IndexErrorException: There were problems performing the index operation.
at coldfusion.tagext.search.IndexTag.updateLuceneCollection(IndexTag.java:2953)
at coldfusion.tagext.search.IndexTag.doQueryUpdate(IndexTag.java:828)
at coldfusion.tagext.search.IndexTag.doStartTag(IndexTag.java:229)
at coldfusion.runtime.CfJspPage._emptyTcfTag(CfJspPage.java:2702)
at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:12)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
at coldfusion.filter.BrowserDebugFilter.invoke(BrowserDebugFilter.java:74)
at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
at coldfusion.CfmServlet.service(CfmServlet.java:177)
at coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
at jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
at coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
at coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
at jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
at jrun.servlet.FilterChain.service(FilterChain.java:101)
at jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
at jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
at jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
at jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
at jrun.servlet.http.WebService.invokeRunnable(WebService.java:172)
at jrunx.scheduler.ThreadPool$DownstreamMetrics.invokeRunnable(ThreadPool.java:320)
at jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
at jrunx.scheduler.ThreadPool$UpstreamMetrics.invokeRunnable(ThreadPool.java:266)
at jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)
----------------------------- Additional Watson Details -----------------------------
Watson Bug ID: 3035807
External Customer Info:
External Company:
External Customer Name: Dave Ferguson
External Customer Email: 333762A94460DE1A992015D5
External Test Config: 08/14/2008
Attachments:
Comments: