Je viens de lancer un audit de site sur asqatasun.org en mode debug avancé mais j’arrive pas très bien a cibler le probleme.
23-05-2016 09:50:45:935 11903 DEBUG org.asqatasun.service.command.factory.AuditCommandFactoryImpl - AuditPageWithCrawler false 23-05-2016 09:50:45:936 11904 DEBUG org.asqatasun.service.command.factory.AuditCommandFactoryImpl - CleanUpRelatedContent true 23-05-2016 09:50:49:118 15086 INFO org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'tgol-web-app': initialization started 23-05-2016 09:51:00:317 26285 INFO org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'tgol-web-app': initialization completed in 11199 ms 23-05-2016 09:57:24:701 410669 INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestratorImpl - Launching audit site on http://asqatasun.org/ 23-05-2016 09:57:24:703 410671 DEBUG org.asqatasun.service.AuditServiceImpl - auditSite 23-05-2016 09:57:24:736 410704 DEBUG org.asqatasun.service.AuditServiceThreadQueueImpl - auditCommand polled 23-05-2016 09:57:24:740 410708 DEBUG org.asqatasun.service.AuditServiceThreadQueueImpl - AuditServiceThread created from auditCommand 23-05-2016 09:57:24:746 410714 DEBUG org.asqatasun.service.AuditServiceThreadQueueImpl - AuditServiceThread started 23-05-2016 09:57:27:361 413329 INFO org.asqatasun.service.command.SiteAuditCommandImpl - Launching crawler for page http://asqatasun.org/ 23-05-2016 09:57:27:471 413439 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - Directory: /var/tmp/asqatasun/crawl-1463990247456 created 23-05-2016 09:57:27:472 413440 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - crawlConfigFilePath: /var/lib/tomcat7/webapps//asqatasun/WEB-INF/conf/crawler/ for copy 23-05-2016 09:57:27:518 413486 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - filepath : /var/lib/tomcat7/webapps//asqatasun/WEB-INF/conf/crawler//asqatasun-crawler-beans-site.xml 23-05-2016 09:57:27:518 413486 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - DEPTH 20 23-05-2016 09:57:27:518 413486 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - SCREEN_WIDTH 1920 23-05-2016 09:57:27:519 413487 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - INFORMATIVE_IMAGE_MARKER 23-05-2016 09:57:27:519 413487 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - COMPLEX_TABLE_MARKER 23-05-2016 09:57:27:519 413487 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - LEVEL Rgaa30;LEVEL_2 23-05-2016 09:57:27:519 413487 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CONSIDER_COOKIES true 23-05-2016 09:57:27:519 413487 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - ALTERNATIVE_CONTRAST_MECHANISM false 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - MAX_DOCUMENTS 1000 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - SCREEN_HEIGHT 1080 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - MAX_DURATION 86400 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - PRESENTATION_TABLE_MARKER 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - DATA_TABLE_MARKER 23-05-2016 09:57:27:520 413488 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - EXCLUSION_REGEXP 23-05-2016 09:57:27:521 413489 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - INCLUSION_REGEXP 23-05-2016 09:57:27:521 413489 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - DECORATIVE_IMAGE_MARKER 23-05-2016 09:57:27:658 413626 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value http://asqatasun.org/ 23-05-2016 09:57:27:807 413775 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - 20 DEPTH 23-05-2016 09:57:27:808 413776 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value 20 23-05-2016 09:57:27:830 413798 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifier - Update maxHops attribute of bean tooManyHopsDecideRule with value 20 23-05-2016 09:57:27:831 413799 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - 1920 SCREEN_WIDTH 23-05-2016 09:57:27:831 413799 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - INFORMATIVE_IMAGE_MARKER 23-05-2016 09:57:27:832 413800 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - COMPLEX_TABLE_MARKER 23-05-2016 09:57:27:832 413800 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Rgaa30;LEVEL_2 LEVEL 23-05-2016 09:57:27:832 413800 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - true CONSIDER_COOKIES 23-05-2016 09:57:27:833 413801 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value true 23-05-2016 09:57:27:851 413819 DEBUG org.asqatasun.crawler.util.HeritrixInverseBooleanAttributeValueModifier - Update ignoreCookies attribute of bean fetchHttp with value false 23-05-2016 09:57:27:852 413820 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - false ALTERNATIVE_CONTRAST_MECHANISM 23-05-2016 09:57:27:852 413820 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - 1000 MAX_DOCUMENTS 23-05-2016 09:57:27:852 413820 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value 1000 23-05-2016 09:57:27:866 413834 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifier - Update maxDocumentsDownload attribute of bean crawlLimiter with value 1000 23-05-2016 09:57:27:867 413835 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - 1080 SCREEN_HEIGHT 23-05-2016 09:57:27:867 413835 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - 86400 MAX_DURATION 23-05-2016 09:57:27:867 413835 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value 86400 23-05-2016 09:57:27:883 413851 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifier - Update maxTimeSeconds attribute of bean crawlLimiter with value 86400 23-05-2016 09:57:27:883 413851 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - PRESENTATION_TABLE_MARKER 23-05-2016 09:57:27:883 413851 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - DATA_TABLE_MARKER 23-05-2016 09:57:27:884 413852 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - EXCLUSION_REGEXP 23-05-2016 09:57:27:884 413852 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value 23-05-2016 09:57:27:897 413865 DEBUG org.asqatasun.crawler.util.HeritrixParameterValueModifier - [list: null] value 23-05-2016 09:57:27:906 413874 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - INCLUSION_REGEXP 23-05-2016 09:57:27:907 413875 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - Modifier found for value 23-05-2016 09:57:27:919 413887 DEBUG org.asqatasun.crawler.util.HeritrixParameterValueModifier - [list: null] value 23-05-2016 09:57:27:925 413893 DEBUG org.asqatasun.crawler.util.CrawlConfigurationUtils - DECORATIVE_IMAGE_MARKER 23-05-2016 09:57:27:946 413914 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifierAndEraser - Update httpProxyHost attribute of bean fetchHttp with value proxy.infra.dgfip 23-05-2016 09:57:27:953 413921 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifierAndEraser - Update httpProxyPort attribute of bean fetchHttp with value 3128 23-05-2016 09:57:27:971 413939 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifierAndEraser - Delete httpProxyUser attribute of bean fetchHttp because of null or empty value 23-05-2016 09:57:27:996 413964 DEBUG org.asqatasun.crawler.util.HeritrixAttributeValueModifierAndEraser - Delete httpProxyPassword attribute of bean fetchHttp because of null or empty value 23-05-2016 09:57:28:296 414264 INFO org.asqatasun.crawler.CrawlerImpl - Rel canonical pages are kept for ref Rgaa30 23-05-2016 09:57:28:297 414265 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - crawljob is launchable 23-05-2016 09:57:29:685 415653 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - Job validated 23-05-2016 09:57:29:686 415654 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - Starting context 23-05-2016 09:57:31:354 417322 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - Context started 23-05-2016 09:57:31:355 417323 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - Request crawl start 23-05-2016 09:57:31:362 417330 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CrawlJob changes state to PREPARING 23-05-2016 09:57:31:411 417379 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - PREPARING 23-05-2016 09:57:31:411 417379 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - crawl start requested 23-05-2016 09:57:32:364 418332 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CrawlJob changes state to RUNNING 23-05-2016 09:57:32:364 418332 INFO org.asqatasun.crawler.framework.AsqatasunCrawlJob - crawljob is running 23-05-2016 09:57:32:368 418336 DEBUG org.asqatasun.crawler.processor.AsqatasunWriterProcessor - should process? http://asqatasun.org/ with mime type unknown false 23-05-2016 09:57:32:502 418470 DEBUG org.asqatasun.crawler.processor.AsqatasunWriterProcessor - should process? dns:asqatasun.org with mime type text/dns false 23-05-2016 09:57:33:506 419474 DEBUG org.asqatasun.crawler.processor.AsqatasunWriterProcessor - should process? dns:asqatasun.org with mime type text/dns false 23-05-2016 09:57:34:511 420479 DEBUG org.asqatasun.crawler.processor.AsqatasunWriterProcessor - should process? dns:asqatasun.org with mime type text/dns false 23-05-2016 09:57:34:516 420484 DEBUG org.asqatasun.crawler.processor.AsqatasunWriterProcessor - should process? http://asqatasun.org/ with mime type unknown false 23-05-2016 09:57:35:372 421340 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CrawlJob changes state to STOPPING 23-05-2016 09:57:35:374 421342 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CrawlJob changes state to EMPTY 23-05-2016 09:57:37:532 423500 DEBUG org.asqatasun.crawler.framework.AsqatasunCrawlJob - CrawlJob changes state to FINISHED 23-05-2016 09:57:38:080 424048 DEBUG org.asqatasun.crawler.CrawlerImpl - remove Orphan related contents 0 elements 23-05-2016 09:57:38:091 424059 DEBUG org.asqatasun.crawler.CrawlerImpl - remove Orphan SSPs 0 elements 23-05-2016 09:57:38:302 424270 DEBUG org.asqatasun.service.CrawlerServiceImpl - Number Of SSP From WebResource http://asqatasun.org/ : 0 23-05-2016 09:57:38:336 424304 DEBUG org.asqatasun.service.CrawlerServiceImpl - Number Of Related Content From WebResource?http://asqatasun.org/ : 0 23-05-2016 09:57:38:385 424353 WARN org.asqatasun.service.AuditServiceImpl - Audit has no content 23-05-2016 09:57:38:561 424529 WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileCONTENT_ADAPTING was required 23-05-2016 09:57:38:662 424630 WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whilePROCESSING was required 23-05-2016 09:57:38:757 424725 WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileCONSOLIDATION was required 23-05-2016 09:57:38:760 424728 WARN org.asqatasun.service.command.AuditCommandImpl - Audit status isERROR whileANALYSIS was required 23-05-2016 09:57:39:240 425208 INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestratorImpl - failure email sent to [dgfip_asqatasun@email.com] on audit n° 40 23-05-2016 09:57:39:328 425296 INFO org.asqatasun.webapp.orchestrator.AsqatasunOrchestratorImpl - Audit site terminated on http://asqatasun.org/