tracker issue : CF-3035807

select a category, or use search below
(searches all categories and all time range)
Title:

Bug 72679:While indexing about 10,000 records from a query the indexing process stopped without error

| View in Tracker

Status/Resolution/Reason: Closed/Withdrawn/

Reporter/Name(from Bugbase): Dave Ferguson / Dave Ferguson (dave_jf)

Created: 08/14/2008

Components: Text Search, Solr

Versions: 9.0

Failure Type: Unspecified

Found In Build/Fixed In Build: 0000 /

Priority/Frequency: Trivial / Unknown

Locale/System: English / Win All

Vote Count: 0

Problem:

While indexing about 10,000 records from a query the indexing process stopped without error.  Any attempts to update that index fail with a coldfusion error of "an error occurred while indexing a Lucene collection".  Creating a new collection after this happens and then trying to index the new collection throws same error.  Digging through the logs I found a out of memory error in the coldfusion-event.log file.  

Cycling the coldfusion service does not clear the issue.  After CF restart the memory error is gone but still unable to index.  This error was found in the coldfusion-out.log "08/14 06:35:03 Error [web-0] - There were problems performing the index operation.An error occurred while indexing a Lucene collection. The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 12"


A reboot of the server did not fix it either. 
Method:

CODE:

<CFQUERY NAME="getData" DATASOURCE="myDSN">
	select top 10000 af.file_id, af.asset_name,af.original_file_name asset_description From asset_files af
	join assets_addl_info aai
	on aai.file_id = af.file_id
		
</CFQUERY>


<CFINDEX ACTION="UPDATE" COLLECTION="testcollection2" QUERY="getData" TYPE="CUSTOM" KEY="file_id" TITLE="assets" BODY="asset_name,original_file_name,asset_description">



Result:

INITIAL ERROR:
08/13 09:45:28 error ROOT CAUSE: 
java.lang.OutOfMemoryError: Java heap space
	at macromedia.util.UtilTransliteratorUsingTable.decode(Unknown Source)
	at macromedia.jdbc.sqlserver.SQLServerByteOrderedDataReader.readString(Unknown Source)
	at macromedia.jdbc.sqlserver.tds.TDSRequest.getReturnedValue(Unknown Source)
	at macromedia.jdbc.sqlserver.tds.TDSRequest.getColumnDataForRow(Unknown Source)
	at macromedia.jdbc.sqlserver.SQLServerImplResultSet.getData(Unknown Source)
	at macromedia.jdbc.base.BaseResultSet.getString(Unknown Source)
	at coldfusion.sql.QueryTable.populate(QueryTable.java:333)
	at coldfusion.sql.QueryTable.populate(QueryTable.java:243)
	at coldfusion.sql.Executive.getRowSet(Executive.java:466)
	at coldfusion.sql.Executive.executeQuery(Executive.java:1252)
	at coldfusion.sql.Executive.executeQuery(Executive.java:1008)
	at coldfusion.sql.Executive.executeQuery(Executive.java:939)
	at coldfusion.sql.SqlImpl.execute(SqlImpl.java:325)
	at coldfusion.tagext.sql.QueryTag.executeQuery(QueryTag.java:831)
	at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:521)
	at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:4)
	at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
	at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
	at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
	at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
	at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
	at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
	at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
	at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
	at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
	at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
	at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
	at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
	at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
	at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
	at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
	at coldfusion.CfmServlet.service(CfmServlet.java:177)


"Error","web-19","08/13/08","09:45:28",,"Java heap space The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 4 "
java.lang.OutOfMemoryError: Java heap space
	at macromedia.util.UtilTransliteratorUsingTable.decode(Unknown Source)
	at macromedia.jdbc.sqlserver.SQLServerByteOrderedDataReader.readString(Unknown Source)
	at macromedia.jdbc.sqlserver.tds.TDSRequest.getReturnedValue(Unknown Source)
	at macromedia.jdbc.sqlserver.tds.TDSRequest.getColumnDataForRow(Unknown Source)
	at macromedia.jdbc.sqlserver.SQLServerImplResultSet.getData(Unknown Source)
	at macromedia.jdbc.base.BaseResultSet.getString(Unknown Source)
	at coldfusion.sql.QueryTable.populate(QueryTable.java:333)
	at coldfusion.sql.QueryTable.populate(QueryTable.java:243)
	at coldfusion.sql.Executive.getRowSet(Executive.java:466)
	at coldfusion.sql.Executive.executeQuery(Executive.java:1252)
	at coldfusion.sql.Executive.executeQuery(Executive.java:1008)
	at coldfusion.sql.Executive.executeQuery(Executive.java:939)
	at coldfusion.sql.SqlImpl.execute(SqlImpl.java:325)
	at coldfusion.tagext.sql.QueryTag.executeQuery(QueryTag.java:831)
	at coldfusion.tagext.sql.QueryTag.doEndTag(QueryTag.java:521)
	at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:4)
	at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
	at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
	at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
	at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
	at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
	at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
	at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
	at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
	at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
	at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
	at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
	at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
	at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
	at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
	at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
	at coldfusion.CfmServlet.service(CfmServlet.java:177)



ERROR AFTER REBOOT:

"Error","web-0","08/14/08","06:38:26",,"There were problems performing the index operation.An error occurred while indexing a Lucene collection. The specific sequence of files included or processed is: E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm, line: 12 "
coldfusion.tagext.search.IndexTag$IndexErrorException: There were problems performing the index operation.
	at coldfusion.tagext.search.IndexTag.updateLuceneCollection(IndexTag.java:2953)
	at coldfusion.tagext.search.IndexTag.doQueryUpdate(IndexTag.java:828)
	at coldfusion.tagext.search.IndexTag.doStartTag(IndexTag.java:229)
	at coldfusion.runtime.CfJspPage._emptyTcfTag(CfJspPage.java:2702)
	at cfcfindex2ecfm973263768.runPage(E:\ColdFusionCentaur\wwwroot\Index\cfindex.cfm:12)
	at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:196)
	at coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:388)
	at coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
	at coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:279)
	at coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
	at coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
	at coldfusion.filter.PathFilter.invoke(PathFilter.java:86)
	at coldfusion.filter.LicenseFilter.invoke(LicenseFilter.java:27)
	at coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
	at coldfusion.filter.BrowserDebugFilter.invoke(BrowserDebugFilter.java:74)
	at coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
	at coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
	at coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
	at coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
	at coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
	at coldfusion.filter.CachingFilter.invoke(CachingFilter.java:53)
	at coldfusion.CfmServlet.service(CfmServlet.java:177)
	at coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
	at jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
	at coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
	at coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
	at jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
	at jrun.servlet.FilterChain.service(FilterChain.java:101)
	at jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
	at jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
	at jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
	at jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
	at jrun.servlet.http.WebService.invokeRunnable(WebService.java:172)
	at jrunx.scheduler.ThreadPool$DownstreamMetrics.invokeRunnable(ThreadPool.java:320)
	at jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
	at jrunx.scheduler.ThreadPool$UpstreamMetrics.invokeRunnable(ThreadPool.java:266)
	at jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)

----------------------------- Additional Watson Details -----------------------------

Watson Bug ID:	3035807

External Customer Info:
External Company:  
External Customer Name: Dave Ferguson
External Customer Email: 333762A94460DE1A992015D5
External Test Config: 08/14/2008

Attachments:

Comments: