Release_1.03
Commit | Description |
---|---|
Sun Jun 17 23:48:33 CEST 2012 by Michael Peter Christen | - merged files - changed behaviour of delete button in vocabulary edit - fixed size numbe in vocabulary listing Changed Files: defaults/yacy.init, htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/DictionaryLoader_p.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/api/yacydoc.java, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java |
Sun Jun 17 23:07:00 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: defaults/yacy.init, htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/DictionaryLoader_p.java, htroot/ViewFile.html, htroot/ViewFile.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java |
Sun Jun 17 11:22:08 CEST 2012 by Michael Peter Christen | removed warnings/unused entities Changed Files: htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/api/yacydoc.java, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java |
Sat Jun 16 22:09:32 CEST 2012 by Michael Peter Christen | refactoring (geolocalzation -> geolocation) Changed Files: htroot/DictionaryLoader_p.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java |
Thu Jun 14 11:43:22 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: .classpath, htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsing_p.html, htroot/AugmentedParsing_p.html, htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, htroot/Triple_p.html, htroot/Triple_p.java, htroot/Triplestore_p.html, htroot/User.html, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuConfig.template, htroot/env/templates/submenuSemantic.template, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/js/Crawler.js, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchtrailer.java, nbproject/project.xml, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/MapTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DCTerms.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/Parser.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/geolocalization/GeonamesLocation.java, source/net/yacy/document/geolocalization/Locations.java, source/net/yacy/document/geolocalization/OpenGeoDBLocation.java, source/net/yacy/document/geolocalization/OverarchingLocation.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/csvParser.java, source/net/yacy/document/parser/docParser.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/genericParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/document/parser/pptParser.java, source/net/yacy/document/parser/psParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rssParser.java, source/net/yacy/document/parser/rtfParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/sidAudioParser.java, source/net/yacy/document/parser/sitemapParser.java, source/net/yacy/document/parser/swfParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/document/parser/vcfParser.java, source/net/yacy/document/parser/vsdParser.java, source/net/yacy/document/parser/xlsParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/yacy.java |
Thu Jun 14 09:44:14 CEST 2012 by Michael Peter Christen | - renamed localization to location (that was confusing) - renamed 'Locale' navigator to 'Location' - produce Location navigation only if geolocation libraries are loaded Changed Files: htroot/DictionaryLoader_p.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/Locations.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/document/geolocalization/OverarchingLocalization.java |
Tue Jun 12 14:23:51 CEST 2012 by Michael Peter Christen | - using http://purl.org/dc/terms/references to refer from an auto-annotated document to a 'pseudo-linked' document which has an url created with an object-prefix as defined in the vocabulary file Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DCTerms.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java |
Mon Jun 11 23:49:30 CEST 2012 by Michael Peter Christen | changed behavior of navigation processing: - vocabulary annotation is not done any more into the metadata of urldb - vocabularies are written into the jena triplestore using a rdf vocabulary - vocabularies for rdf tripel must be updated; refactoring done - with the new navigation tags in the triplestore a faster pre-urldb-lookup is possible: navigation is processed now within the RWI during pre-ranking retrieval - added also a Owl vocabulary stub to add the plain-text url to the triplestore using the owl:sameas predicate Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java |
Mon Jun 11 16:48:53 CEST 2012 by Michael Peter Christen | - moved triple store to net.yacy.cora.lod (should be generalized there later - added abstract add, delete, get methods in the triplestore - added generation of triples after auto-annotation - migrated all MultiProtocolURI objects to DigestURI in the parser since the url hash is needed as subject value in the triples in the triple store Changed Files: .classpath, htroot/Triple_p.java, htroot/User.html, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/MapTripleStore.java, source/net/yacy/cora/lod/SimpleVocabulary.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/Parser.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/csvParser.java, source/net/yacy/document/parser/docParser.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/genericParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/document/parser/pptParser.java, source/net/yacy/document/parser/psParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rdfa/main.java, source/net/yacy/document/parser/rssParser.java, source/net/yacy/document/parser/rtfParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/sidAudioParser.java, source/net/yacy/document/parser/sitemapParser.java, source/net/yacy/document/parser/swfParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/document/parser/vcfParser.java, source/net/yacy/document/parser/vsdParser.java, source/net/yacy/document/parser/xlsParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java |
Mon Jun 11 00:17:30 CEST 2012 by Roland 'Quix0r' Haeder | Rewrote all String blacklist types to enum 'BlacklistType', closes bug #143 Conflicts: htroot/Supporter.java htroot/yacy/crawlReceipt.java htroot/yacy/transferRWI.java htroot/yacy/transferURL.java source/de/anomic/crawler/CrawlStacker.java source/de/anomic/data/ListManager.java source/net/yacy/peers/Protocol.java source/net/yacy/repository/Blacklist.java source/net/yacy/repository/LoaderDispatcher.java source/net/yacy/search/Switchboard.java source/net/yacy/search/index/MetadataRepository.java source/net/yacy/search/index/Segment.java source/net/yacy/search/query/RWIProcess.java source/net/yacy/search/snippet/MediaSnippet.java Changed Files: htroot/BlacklistCleaner_p.java, htroot/BlacklistTest_p.java, htroot/Blacklist_p.java, htroot/IndexControlRWIs_p.java, htroot/Supporter.java, htroot/Surftips.java, htroot/api/blacklists_p.java, htroot/sharedBlacklist_p.java, htroot/yacy/crawlReceipt.java, htroot/yacy/transferRWI.java, htroot/yacy/transferURL.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/data/ListManager.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/peers/NewsPool.java, source/net/yacy/peers/Protocol.java, source/net/yacy/repository/Blacklist.java, source/net/yacy/repository/BlacklistFile.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/MetadataRepository.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/snippet/MediaSnippet.java |
Sun Jun 10 23:33:09 CEST 2012 by cominch | - removed unused variables - do not replace malformed or invalid URLs in urlproxy git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7835 6c8d7289-2bf4-0310-a012-ef5d649a1542 Conflicts: source/de/anomic/http/server/HTTPDFileHandler.java Changed Files: htroot/Triple_p.java, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/interaction/Table.java, htroot/interaction/Triple.java, htroot/interaction/UploadSingleFile.java, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java |
Sun Jun 10 10:42:33 CEST 2012 by cominch | Add several parsers, for RDFa and rdf files. Conflicts: source/net/yacy/document/TextParser.java Changed Files: RDFaParser/RDFaParser.xsl, htroot/interaction/OverlayInteraction.html, source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/IRDFaTriple.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaTripleContent.java, source/net/yacy/document/parser/rdfa/impl/RDFaTripleImpl.java, source/net/yacy/document/parser/rdfa/main.java |
Sun Jun 10 10:35:59 CEST 2012 by cominch | Add Triplestore and RDF query interface Conflicts: build.xml defaults/yacy.init source/net/yacy/interaction/AugmentHtmlStream.java Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, defaults/yacy.init, htroot/Triple_p.html, htroot/Triple_p.java, htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayInteraction.java, lib/arq-2.8.7.jar, lib/iri-0.8.jar, lib/jena-2.6.4.jar, lib/sax-2.0.1.jar, source/net/yacy/interaction/AugmentHtmlStream.java |
Tue Jun 05 20:03:43 CEST 2012 by Michael Peter Christen | removed warnings Changed Files: htroot/sharedBlacklist_p.java, source/de/anomic/crawler/CrawlProfile.java, source/de/anomic/crawler/CrawlStacker.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/document/content/dao/ImportDump.java, source/net/yacy/document/importer/OAIListFriendsLoader.java, source/net/yacy/kelondro/blob/MapColumnIndex.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java |
Tue Jun 05 12:06:26 CEST 2012 by Michael Peter Christen | performance hacks Changed Files: htroot/IndexControlRWIs_p.java, htroot/yacysearch.java, source/de/anomic/tools/crypt.java, source/net/yacy/kelondro/rwi/AbstractIndex.java, source/net/yacy/kelondro/rwi/Index.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/peers/dht/Dispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SearchEventCache.java |
Mon Jun 04 15:37:39 CEST 2012 by Michael Peter Christen | - performance hacks - added log warnings in case that search processes run into time-out situations - better concurrency for Integer formatter (used a non-synchronized formatter before) - bugfix for search termination (a poison pill was missing) - added timeout parameters for search (again) -> target is, that they are never reached. Changed Files: htroot/AccessTracker_p.java, htroot/yacy/search.java, htroot/yacysearch.java, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/index/RowSet.java, source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java, source/net/yacy/kelondro/logging/ConsoleOutHandler.java, source/net/yacy/kelondro/util/Formatter.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/AccessTracker.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/ReferenceOrder.java |
Thu May 31 22:39:53 CEST 2012 by Michael Peter Christen | ehanced location search: - search request are now made using a map boundary - search results are only computed for the map boundary - the number of results is adopted to the results in the visible range - added a double-buffering for the search result markers - added a search query option for the search results: /radius/<lat>/<lon>/<radius> Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/de/anomic/crawler/ResultURLs.java, source/de/anomic/server/serverObjects.java, source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/document/Document.java, source/net/yacy/document/content/DCEntry.java, source/net/yacy/document/content/dao/PhpBB3Dao.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/kelondro/data/meta/URIMetadata.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/SolrConfiguration.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ResultEntry.java |
Wed May 30 16:59:13 CEST 2012 by Michael Peter Christen | performance hack: use a hash cache for all hashes that are computed by a byte array. If this hash is used in a HashMap (which is very often the case) then this hack eliminates a lot of re-computations of the same hash. Changed Files: source/net/yacy/kelondro/data/citation/CitationReference.java, source/net/yacy/kelondro/data/image/ImageReferenceRow.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/kelondro/data/word/WordReferenceRow.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/search/snippet/MediaSnippet.java, source/net/yacy/search/snippet/ResultEntry.java, source/net/yacy/search/snippet/TextSnippet.java |
Wed May 30 14:46:21 CEST 2012 by sixcooler | bump to httpclient- httpcore-, httpmime- 4.2 Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/httpclient-4.2.License, lib/httpclient-4.2.jar, lib/httpcore-4.2.License, lib/httpcore-4.2.jar, lib/httpmime-4.2.License, lib/httpmime-4.2.jar, nbproject/project.xml, source/net/yacy/cora/protocol/http/HTTPClient.java |
Mon May 28 23:53:48 CEST 2012 by Michael Peter Christen | replaced old bzip2 library against better documented commons-compress package from http://commons.apache.org/compress/ Changed Files: .classpath, .settings/org.eclipse.jdt.core.prefs, addon/YaCy.app/Contents/Info.plist, build.xml, lib/commons-compress-1.4.1.License, lib/commons-compress-1.4.1.jar, source/net/yacy/dbtest.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/bzipParser.java |
Thu May 24 13:24:31 CEST 2012 by Michael Peter Christen | changed log-in text for all servlets with authentication: - added hint how to set the password using a shell script - added a shell script to change the password Changed Files: bin/passwd.sh, htroot/Blog.java, htroot/BlogComments.java, htroot/Bookmarks.java, htroot/ConfigBasic.java, htroot/ConfigParser.java, htroot/ConfigPortal.java, htroot/CrawlResults.java, htroot/Network.java, htroot/News.java, htroot/Status.java, htroot/Steering.java, htroot/Supporter.java, htroot/Surftips.java, htroot/User.java, htroot/ViewFile.java, htroot/Wiki.java, htroot/api/bookmarks/posts/add_p.java, htroot/api/bookmarks/posts/delete_p.java, htroot/api/bookmarks/tags/getTag.java, htroot/api/bookmarks/xbel/xbel.java, htroot/api/ymarks/add_ymark.java, htroot/api/ymarks/delete_ymark.java, htroot/api/ymarks/get_metadata.java, htroot/api/ymarks/get_treeview.java, htroot/api/ymarks/get_xbel.java, htroot/api/ymarks/get_ymark.java, htroot/api/ymarks/import_ymark.java, htroot/api/ymarks/manage_tags.java, htroot/api/ynetSearch.java, htroot/index.java, htroot/yacysearch.java, source/de/anomic/data/ymark/YMarkTables.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/server/serverObjects.java, source/de/anomic/server/servletProperties.java |
Mon May 21 17:52:30 CEST 2012 by Michael Peter Christen | add-on to latest commit Changed Files: htroot/QuickCrawlLink_p.java, htroot/YaCySearchPluginFF.java, htroot/autoconfig.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/date/GenericFormatter.java, source/net/yacy/cora/protocol/HeaderFramework.java, source/net/yacy/cora/util/NumberTools.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/OS.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java |
Mon May 21 13:40:46 CEST 2012 by Michael Peter Christen | performance hack to parse numbers inside of substrings without actually generating a substring. This avoids the allocation of a String object ech time a substring is parsed. Should affect CPU load during RWI transmission. Changed Files: htroot/QuickCrawlLink_p.java, htroot/YaCySearchPluginFF.java, htroot/autoconfig.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/date/GenericFormatter.java, source/net/yacy/cora/protocol/HeaderFramework.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/NumberTools.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java |
Mon May 21 03:03:47 CEST 2012 by Michael Peter Christen | added a "fromCache" flag in Response object to omit one cache.has() check during snippet generation. This should cause less blockings Changed Files: source/de/anomic/crawler/retrieval/FTPLoader.java, source/de/anomic/crawler/retrieval/FileLoader.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/crawler/retrieval/SMBLoader.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/snippet/TextSnippet.java |
Sat May 19 01:06:33 CEST 2012 by Michael Peter Christen | bugfix to http://bugs.yacy.net/view.php?id=181 tried to make a bit less 'noise' to dns server also included: less processes in snippet fetch to reduce load during search on small computers Changed Files: htroot/IndexControlURLs_p.java, htroot/yacysearchitem.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/data/ymark/YMarkUtil.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/peers/graphics/WebStructureGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/SnippetProcess.java |
Wed May 16 13:42:32 CEST 2012 by Michael Peter Christen | removed (not all) warnings Changed Files: htroot/Banner.java, htroot/Table_API_p.java, htroot/yacysearchitem.java, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/de/anomic/http/server/TemplateEngine.java, source/de/anomic/tools/loaderThreads.java, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/kelondro/logging/ThreadDump.java, source/net/yacy/peers/graphics/NetworkGraph.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/yacy.java |
Tue May 15 22:34:02 CEST 2012 by reger | Add possibility to set custom Solr field names for the YaCy default Solr attributes. - Changing the format of YaCy's solr.key.list while maintainig backward compatibility Federated index config screens adjusted accordingly - modified the Solr update request to use a 3 min Solr autocommit intervall Changed Files: htroot/IndexFederated_p.html, htroot/IndexFederated_p.java, htroot/api/schema_p.java, htroot/api/schema_p.xml, source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrShardingSelection.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java, source/net/yacy/search/index/SolrField.java, source/net/yacy/search/query/SnippetProcess.java |
Tue May 15 13:13:07 CEST 2012 by Michael Peter Christen | added missing serialization to remove all warnings Changed Files: source/net/yacy/kelondro/data/citation/CitationReference.java, source/net/yacy/kelondro/data/citation/CitationReferenceFactory.java, source/net/yacy/kelondro/data/image/ImageReferenceFactory.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/navigation/NavigationReferenceFactory.java, source/net/yacy/kelondro/data/navigation/NavigationReferenceVars.java, source/net/yacy/kelondro/data/word/WordReferenceFactory.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/order/Bitfield.java, source/net/yacy/kelondro/rwi/ReferenceContainer.java, source/net/yacy/peers/graphics/WebStructureGraph.java |
Tue May 15 12:55:15 CEST 2012 by Michael Peter Christen | made HandleSet serializable Changed Files: .classpath, source/net/yacy/cora/order/ByteOrder.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/HandleSet.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/index/RowCollection.java, source/net/yacy/kelondro/index/RowSet.java, source/net/yacy/kelondro/order/Base64Order.java, source/net/yacy/kelondro/order/NaturalOrder.java, source/net/yacy/kelondro/order/StringOrder.java |
Mon May 14 07:41:55 CEST 2012 by Roland 'Quix0r' Haeder | Now used synchronization in all close() methods to make sure all objects are 'closed' in an ordered way Conflicts: source/de/anomic/http/server/ChunkedInputStream.java source/de/anomic/http/server/ChunkedOutputStream.java source/de/anomic/http/server/ContentLengthInputStream.java source/net/yacy/cora/protocol/Domains.java source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java source/net/yacy/document/content/dao/PhpBB3Dao.java source/net/yacy/document/parser/html/AbstractTransformer.java source/net/yacy/kelondro/blob/BEncodedHeap.java source/net/yacy/kelondro/blob/HeapReader.java source/net/yacy/kelondro/index/RAMIndexCluster.java source/net/yacy/kelondro/io/ByteCountInputStream.java source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java source/net/yacy/kelondro/table/SQLTable.java Changed Files: source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/crawler/CrawlSwitchboard.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/data/BlogBoard.java, source/de/anomic/data/BlogBoardComments.java, source/de/anomic/data/BookmarkDate.java, source/de/anomic/data/BookmarksDB.java, source/de/anomic/data/MessageBoard.java, source/de/anomic/data/UserDB.java, source/de/anomic/data/wiki/WikiBoard.java, source/de/anomic/http/server/ChunkedInputStream.java, source/de/anomic/http/server/ChunkedOutputStream.java, source/de/anomic/http/server/ContentLengthInputStream.java, source/de/anomic/server/serverCore.java, source/net/yacy/cora/lod/TripleStore.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/storage/KeyList.java, source/net/yacy/cora/storage/ZIPReader.java, source/net/yacy/cora/storage/ZIPWriter.java, source/net/yacy/document/Document.java, source/net/yacy/document/SentenceReader.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/document/content/dao/DatabaseConnection.java, source/net/yacy/document/content/dao/ImportDump.java, source/net/yacy/document/content/dao/PhpBB3Dao.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/html/AbstractTransformer.java, source/net/yacy/document/parser/html/ContentTransformer.java, source/net/yacy/document/parser/html/ScraperInputStream.java, source/net/yacy/kelondro/blob/BEncodedHeap.java, source/net/yacy/kelondro/blob/BEncodedHeapShard.java, source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/kelondro/blob/Tables.java, source/net/yacy/kelondro/index/BufferedObjectIndex.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/index/RAMIndexCluster.java, source/net/yacy/kelondro/io/ByteCountInputStream.java, source/net/yacy/kelondro/io/CharBuffer.java, source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/kelondro/rwi/ReferenceIterator.java, source/net/yacy/kelondro/table/SQLTable.java, source/net/yacy/kelondro/util/XMLTables.java, source/net/yacy/peers/NewsDB.java, source/net/yacy/peers/NewsQueue.java, source/net/yacy/peers/graphics/WebStructureGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/Segments.java, source/org/apache/tools/tar/TarBuffer.java, source/org/apache/tools/tar/TarInputStream.java, source/org/apache/tools/tar/TarOutputStream.java |
Wed May 09 16:46:45 CEST 2012 by Michael Peter Christen | made the solr connection more generic Changed Files: htroot/IndexFederated_p.java, htroot/api/schema_p.java, source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/services/federated/solr/SolrType.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrField.java, source/net/yacy/search/index/SolrScheme.java, source/net/yacy/search/query/SnippetProcess.java |
Tue Apr 24 16:07:03 CEST 2012 by Michael Peter Christen | - Redesigned crawler and parser to accept embedded links from the NOLOAD queue and not from virtual documents generated by the parser. - The parser now generates nice description texts for NOLOAD entries which shall make it possible to find media content using the search index and not using the media prefetch algorithm during search (which was costly) - Removed the media-search prefetch process from image search Changed Files: source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/net/yacy/document/Document.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java |
Sun Apr 22 02:05:17 CEST 2012 by Michael Peter Christen | new indexing strategy: ALL links that appear anywhere are indexed, not only links where the content can be parsed. All non-parseable links are placed into the noload queue. The search process must therefore be able to filter out non-text search results. - This fixes the problem that image search results appeared in the text search. - The interactive search can retrieve now ALL types of links - The p2p interface is now extended to retrieve only certain types of links (text, image, video, apps) - The search process has an extension to filter the right document type according to the search query Changed Files: htroot/js/yacyinteractive.js, htroot/yacy/search.java, htroot/yacyinteractive.html, htroot/yacysearch.java, htroot/yacysearchitem.java, source/de/anomic/crawler/CrawlStacker.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/peers/Protocol.java, source/net/yacy/peers/RemoteSearch.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java |
Sun Apr 22 00:04:36 CEST 2012 by Michael Peter Christen | refactoring of ContentDomain: now subclass of Classification Changed Files: htroot/Ranking_p.java, htroot/index.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEventCache.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java |
Sat Apr 21 13:34:07 CEST 2012 by Michael Peter Christen | refactoring: the cache belongs to the crawler Changed Files: htroot/CacheResource_p.java, htroot/ConfigHTCache_p.java, htroot/IndexControlRWIs_p.java, htroot/ProxyIndexingMonitor_p.java, htroot/ViewFile.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/Cache.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/peers/graphics/OSMTile.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java |
Fri Apr 13 07:09:15 CEST 2012 by Michael Christen | added stub classes for - a new database for url reference data ('seen links') - a new database extending the references to the full url metadata attributes set which shall replace the old metadata database if it is finished - migration help classes stub to use old and new metadata databases simultanously Changed Files: source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/kelondro/data/meta/URIMetadata.java, source/net/yacy/kelondro/data/meta/URIMetadataNode.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/data/meta/URIReference.java, source/net/yacy/kelondro/data/meta/URIReferenceNode.java, source/net/yacy/search/index/DocumentMetadata.java, source/net/yacy/search/index/DocumentReference.java, source/net/yacy/search/index/Metadata.java, source/net/yacy/search/index/MetadataMigration.java, source/net/yacy/search/index/MetadataRepository.java |
Mon Feb 27 00:42:32 CET 2012 by Michael Peter Christen | ConcurrentLinkedQueue has a VERY long return time on the .size() method. See http://docs.oracle.com/javase/6/docs/api/java/util/concurrent/ConcurrentLinkedQueue.html and the following test programm: public class QueueLengthTimeTest { public static long countTest(Queue<Integer> q, int c) { long t = System.currentTimeMillis(); for (int i = 0; i < c; i++) { q.add(q.size()); } return System.currentTimeMillis() - t; } public static void main(String[] args) { int c = 1; for (int i = 0; i < 100; i++) { Runtime.getRuntime().gc(); long t1 = countTest(new ArrayBlockingQueue<Integer>(c), c); Runtime.getRuntime().gc(); long t2 = countTest(new LinkedBlockingQueue<Integer>(), c); Runtime.getRuntime().gc(); long t3 = countTest(new ConcurrentLinkedQueue<Integer>(), c); System.out.println("count = " + c + ": ArrayBlockingQueue = " + t1 + ", LinkedBlockingQueue = " + t2 + ", ConcurrentLinkedQueue = " + t3); c = c * 2; } } } Changed Files: htroot/AccessTracker_p.java, source/de/anomic/crawler/ResultImages.java, source/de/anomic/crawler/ZURL.java, source/de/anomic/data/URLLicense.java, source/de/anomic/server/serverAccessTracker.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/util/EventTracker.java |
Commit | Description |
---|---|
Tue Jun 19 08:23:10 CEST 2012 by Michael Peter Christen | enable asserts only with debugging Changed Files: startYACY.sh |
Tue Jun 19 07:44:44 CEST 2012 by Michael Peter Christen | fixed problem with seed when switching network Changed Files: source/net/yacy/peers/SeedDB.java |
Mon Jun 18 21:25:39 CEST 2012 by Michael Peter Christen | fix for npe, possibly for http://bugs.yacy.net/view.php?id=195 Changed Files: source/net/yacy/repository/LoaderDispatcher.java |
Mon Jun 18 18:10:40 CEST 2012 by Michael Peter Christen | bugfix in vocabulary generation Changed Files: htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java |
Mon Jun 18 16:16:31 CEST 2012 by cominch | Augmented browsing: CSS fix Changed Files: htroot/interaction_elements/Document_part.html, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/Tag_part.html |
Mon Jun 18 12:01:03 CEST 2012 by cominch | Augmented browsing: small UI fix Changed Files: htroot/interaction_elements/Document_part.html, htroot/interaction_elements/Tag_part.html |
Mon Jun 18 00:33:32 CEST 2012 by Michael Peter Christen | IPv6 bugfix Changed Files: source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/peers/Seed.java |
Sun Jun 17 17:18:19 CEST 2012 by Michael Peter Christen | fixed wrong parsing of style and script Changed Files: source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java |
Sun Jun 17 11:08:33 CEST 2012 by Michael Peter Christen | fix for objectlink of PND vocabulary Changed Files: source/net/yacy/document/LibraryProvider.java |
Sat Jun 16 22:06:59 CEST 2012 by Michael Peter Christen | fix for OpenGeoDB loader Changed Files: source/net/yacy/document/geolocalization/OpenGeoDBLocation.java |
Sat Jun 16 13:12:02 CEST 2012 by Michael Peter Christen | fixed vocabulary initialization Changed Files: htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java |
Sat Jun 16 08:25:28 CEST 2012 by Michael Peter Christen | jquery bugfix Changed Files: htroot/env/templates/jqueryheader.template, htroot/env/templates/metas.template, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java |
Thu Jun 14 18:05:10 CEST 2012 by cominch | hotfix for unresolved pattern Changed Files: htroot/yacysearchitem.html |
Thu Jun 14 17:56:38 CEST 2012 by cominch | hotfix until we have updated query routine for tags Changed Files: htroot/yacysearchitem.java |
Thu Jun 14 02:13:23 CEST 2012 by sixcooler | fix for reload-feature in Crawler_p Changed Files: htroot/js/Crawler.js |
Sun Jun 10 14:44:37 CEST 2012 by Michael Peter Christen | fix for autocomplete in index.html Changed Files: htroot/index.html |
Fri Jun 08 10:11:48 CEST 2012 by cominch | bugfix Changed Files: source/net/yacy/document/Document.java |
Wed Feb 15 15:30:53 CET 2012 by cominch | Small fix - return value of JSON should be empty Changed Files: htroot/interaction/interaction.js |
Wed Feb 15 14:13:15 CET 2012 by cominch | Quick fix Changed Files: htroot/Triple_p.html |
Sat Jun 09 10:59:45 CEST 2012 by Michael Peter Christen | bugfix in Domains - dns-lookup Changed Files: source/net/yacy/cora/protocol/Domains.java |
Fri Jun 08 17:14:09 CEST 2012 by Michael Peter Christen | fix for OOM Changed Files: source/net/yacy/kelondro/table/Table.java |
Fri Jun 08 10:20:43 CEST 2012 by Michael Peter Christen | npe bugfix Changed Files: source/net/yacy/kelondro/order/MergeIterator.java |
Thu Jun 07 12:36:05 CEST 2012 by Michael Peter Christen | fix for NPE in PerformanceMemory Changed Files: htroot/PerformanceMemory_p.java |
Wed Jun 06 18:23:18 CEST 2012 by Michael Peter Christen | a variety of possible memory leak fixes Changed Files: source/net/yacy/cora/protocol/Domains.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/cora/storage/HashARC.java, source/net/yacy/cora/storage/KeyList.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java |
Wed Jun 06 14:13:31 CEST 2012 by Michael Peter Christen | fixes for bad long computation Changed Files: htroot/PerformanceMemory_p.java, htroot/PerformanceQueues_p.java, htroot/ProxyIndexingMonitor_p.java, htroot/YBRFetch_p.java, source/net/yacy/search/Switchboard.java |
Tue Jun 05 15:04:23 CEST 2012 by Michael Peter Christen | more bug fixes and performance hacks for search process Changed Files: source/de/anomic/data/BookmarksDB.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java |
Mon Jun 04 23:37:41 CEST 2012 by Michael Peter Christen | more fixes for double precision of coordinates Changed Files: source/de/anomic/data/wiki/WikiCode.java, source/net/yacy/document/geolocalization/Coordinates.java, source/net/yacy/document/parser/html/ContentScraper.java |
Mon Jun 04 16:33:16 CEST 2012 by Michael Peter Christen | fix for bad distance computation Changed Files: source/net/yacy/search/query/RWIProcess.java |
Wed May 30 15:28:45 CEST 2012 by Michael Peter Christen | npe fix Changed Files: htroot/PerformanceMemory_p.java |
Tue May 29 14:46:13 CEST 2012 by Michael Peter Christen | fix for bad location evaluation Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/de/anomic/server/serverObjects.java |
Tue May 29 13:08:27 CEST 2012 by Michael Peter Christen | fixes for wrong port number in shell scripts Changed Files: bin/checkalive.sh, bin/graphicstest.sh |
Tue May 29 12:43:14 CEST 2012 by Michael Peter Christen | fixes to location search Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java |
Fri May 25 16:21:44 CEST 2012 by Michael Peter Christen | fix for http://bugs.yacy.net/view.php?id=188 Changed Files: source/de/anomic/data/DidYouMean.java |
Fri May 25 15:56:21 CEST 2012 by Michael Peter Christen | another patch to fix the Crawler_p layout Changed Files: htroot/Crawler_p.html, htroot/js/Crawler.js |
Sun May 20 02:59:47 CEST 2012 by Michael Peter Christen | more classification bugs Changed Files: source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java |
Sun May 20 01:35:49 CEST 2012 by Michael Peter Christen | fixed bad usage of given words Changed Files: htroot/IndexControlRWIs_p.java |
Sun May 20 01:23:02 CEST 2012 by Michael Peter Christen | search contentdom was checked in wrong way - fixed Changed Files: source/net/yacy/search/query/RWIProcess.java |
Sat May 19 23:15:29 CEST 2012 by reger | bugfix Tables_p for edit and delete selected row (correction to use "pk_" html prefex) Changed Files: htroot/Tables_p.java |
Sat May 19 00:21:03 CEST 2012 by Michael Peter Christen | fix for http://bugs.yacy.net/view.php?id=126 Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/cora/protocol/http/HTTPClient.java, source/net/yacy/document/parser/html/EmbedEntry.java, source/net/yacy/document/parser/html/ImageEntry.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java |
Fri May 18 23:56:40 CEST 2012 by Michael Peter Christen | fix for http://bugs.yacy.net/view.php?id=154 Changed Files: htroot/ConfigPortal.java |
Fri May 18 22:18:47 CEST 2012 by Michael Peter Christen | bugfix for http://bugs.yacy.net/view.php?id=186 Changed Files: source/net/yacy/search/Switchboard.java |
Tue May 15 12:25:14 CEST 2012 by Michael Peter Christen | fixed bug in solr interface Changed Files: source/net/yacy/search/index/MetadataRepository.java |
Mon May 14 14:56:21 CEST 2012 by Michael Peter Christen | fixed bug in solr error document Changed Files: source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/ZURL.java, source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrMultipleConnector.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/index/SolrConfiguration.java |
Mon May 14 11:56:04 CEST 2012 by Michael Peter Christen | solrj connector bugfix Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/Switchboard.java |
Wed May 09 12:29:07 CEST 2012 by Michael Peter Christen | patch for broken configurations Changed Files: source/net/yacy/search/Switchboard.java |
Fri May 04 17:28:27 CEST 2012 by Michael Peter Christen | refactoring + parser bugfixes Changed Files: htroot/PerformanceSearch_p.java, htroot/yacy/hello.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, htroot/yacysearchtrailer.java, source/de/anomic/crawler/RobotsTxt.java, source/de/anomic/crawler/RobotsTxtParser.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/Evaluation.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/kelondro/blob/Stack.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/peers/Protocol.java, source/net/yacy/peers/graphics/ProfilingGraph.java, source/net/yacy/search/EventTracker.java, source/net/yacy/search/MemoryTracker.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java |
Fri Apr 27 17:53:45 CEST 2012 by Michael Peter Christen | solrj user authentication patch Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java |
Fri Apr 27 14:18:02 CEST 2012 by Michael Peter Christen | patch for media search (audio, video apps) Changed Files: htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/search/index/Segment.java |
Fri Apr 27 14:13:59 CEST 2012 by Michael Peter Christen | fix needed for new solrj library Changed Files: source/net/yacy/cora/services/federated/solr/SolrScheme.java |
Thu Apr 26 00:04:23 CEST 2012 by Michael Peter Christen | fix for search result selection in case that contentdom is not set Changed Files: htroot/yacysearch.java |
Tue Apr 17 11:46:14 CEST 2012 by Michael Peter Christen | fixed to network graph testing Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java |
Fri Apr 13 09:02:18 CEST 2012 by Michael Peter Christen | fix to xml output format Changed Files: htroot/api/webstructure.java |
Fri Apr 13 11:52:59 CEST 2012 by Michael Christen | fix to url citation collection Changed Files: source/net/yacy/search/index/Segment.java |
Wed Mar 21 21:43:47 CET 2012 by Thomas | Fixes for compare-search Changed Files: htroot/compare_yacy.java |
Sat Mar 10 10:59:56 CET 2012 by Lotus | fix links & bug #163 Changed Files: htroot/Status_p.inc |
Commit | Description |
---|---|
Tue Jun 19 08:51:26 CEST 2012 by Michael Peter Christen | Release 1.03 Changed Files: build.properties |
Tue Jun 19 08:45:49 CEST 2012 by Michael Peter Christen | set Xms lower than Xmx Changed Files: defaults/yacy.init, htroot/PerformanceQueues_p.java |
Tue Jun 19 08:45:34 CEST 2012 by Michael Peter Christen | removed unimportant warnings Changed Files: source/de/anomic/crawler/RobotsTxt.java, source/net/yacy/document/TextParser.java, source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/upnp/DiscoveryAdvertisement.java |
Tue Jun 19 01:40:22 CEST 2012 by cominch | Only load tag information if necessary Changed Files: htroot/interaction_elements/Tag_part.html |
Tue Jun 19 01:24:06 CEST 2012 by cominch | Auto Tagging: Add hyperlinks to tags (provisional) Changed Files: htroot/api/yacydoc.htm, htroot/api/yacydoc.java, htroot/env/templates/jqueryheader.template, htroot/interaction_elements/Tag_part.html, htroot/interaction_elements/interaction.js, htroot/jquery/js/jquery.rdfquery.core-1.0.js |
Mon Jun 18 16:16:46 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: htroot/ViewFile.java, htroot/api/yacydoc.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/protocol/RequestHeader.java |
Mon Jun 18 15:55:18 CEST 2012 by Michael Peter Christen | better abstraction of document model generation Changed Files: htroot/ViewFile.java, htroot/api/yacydoc.java, source/net/yacy/cora/lod/JenaTripleStore.java |
Mon Jun 18 15:47:54 CEST 2012 by Michael Peter Christen | produce a rdf output containing the triplestore with yacydoc; ie: http://localhost:8090/api/yacydoc.rdf?urlhash=yOiCM7Fh1hyQ Changed Files: htroot/api/yacydoc.java, source/net/yacy/cora/protocol/RequestHeader.java |
Mon Jun 18 15:44:50 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/Vocabulary_p.xml, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java |
Mon Jun 18 15:44:01 CEST 2012 by cominch | Augmented browsing: Pass on additional action parameter Changed Files: htroot/interaction_elements/Document_part.java, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/interaction/AugmentHtmlStream.java |
Mon Jun 18 15:19:57 CEST 2012 by Michael Peter Christen | integrate also geonames library files for less cities. these are more useful for tagging since less normal words are false-identified as location Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java |
Mon Jun 18 13:04:20 CEST 2012 by Michael Peter Christen | better apilink description Changed Files: htroot/Vocabulary_p.html |
Mon Jun 18 13:02:12 CEST 2012 by Michael Peter Christen | added ontology extraction in xml as api call for vocabularies Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/Vocabulary_p.xml |
Mon Jun 18 12:11:07 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/peers/Seed.java |
Mon Jun 18 01:22:39 CEST 2012 by Michael Peter Christen | preventing that an empty pnd is inserted into the vocabularies Changed Files: source/net/yacy/document/LibraryProvider.java |
Sun Jun 17 23:05:53 CEST 2012 by cominch | Augmented Browsing: added template for document info bar Changed Files: htroot/api/getpageinfo.java, htroot/interaction_elements/Document_part.html, htroot/interaction_elements/Document_part.java, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/document.png, htroot/interaction_elements/interaction_metadata.js |
Sun Jun 17 19:03:53 CEST 2012 by Michael Peter Christen | more logging Changed Files: source/net/yacy/document/importer/OAIPMHLoader.java |
Sun Jun 17 17:32:52 CEST 2012 by Michael Peter Christen | - added size of vocabulary to vocabulary view - fixed bad terms in vocabulary-from-titles autogeneration Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java |
Sun Jun 17 14:53:16 CEST 2012 by Michael Peter Christen | added more methods to vocabulary generation: scrape document title and document author to vocabulary Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/interaction/Triple.java, source/net/yacy/cora/lod/JenaTripleStore.java |
Sun Jun 17 10:50:12 CEST 2012 by Michael Peter Christen | - automatic periodic saving of triplestore - transaction-safe storage of triplestore Changed Files: source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/search/Switchboard.java, source/net/yacy/yacy.java |
Sun Jun 17 10:15:26 CEST 2012 by Michael Peter Christen | - accept only location names wit a minimum length - remove comma from synonym terms Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java |
Sun Jun 17 01:12:31 CEST 2012 by Michael Peter Christen | - use only names which consists of at least two parts - remove word from derewo from locations Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java |
Sun Jun 17 00:33:40 CEST 2012 by Michael Peter Christen | removed old navigation practice using subject tags in favor of triplestore-tags Changed Files: htroot/yacysearch.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/query/RWIProcess.java |
Sat Jun 16 22:30:31 CEST 2012 by Michael Peter Christen | more robust OAI-PMH client (large time-out, three re-tries). OAI-PMH server appeart to be very slow sometimes Changed Files: defaults/yacy.init, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/net/yacy/document/importer/OAIPMHLoader.java |
Sat Jun 16 19:40:27 CEST 2012 by Michael Peter Christen | added recognition of multi-word terms in vocabulary matching this makes the PND usable: it is now possible to recognize persons and navigate with a 'Persons' facet. Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java |
Sat Jun 16 17:40:15 CEST 2012 by Michael Peter Christen | show triplestore metadata in yacydoc and viewfile Changed Files: htroot/ViewFile.html, htroot/ViewFile.java, htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/document/Autotagging.java, source/net/yacy/search/query/RWIProcess.java |
Sat Jun 16 15:57:00 CEST 2012 by Michael Peter Christen | ipv6 update Changed Files: source/net/yacy/cora/protocol/Domains.java |
Sat Jun 16 12:36:15 CEST 2012 by Michael Peter Christen | added the generation of virtual vocabularies using the pnd Changed Files: htroot/Vocabulary_p.java, htroot/interaction/Triple.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java |
Fri Jun 15 19:19:18 CEST 2012 by Michael Peter Christen | - added loading of the dbpedia pnd triplestore in the dictionary loader - renamed the dictionary loader to knowledge loader - some refactoring in the library provider method names Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/env/templates/submenuSemantic.template, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/OverarchingLocation.java |
Fri Jun 15 19:13:07 CEST 2012 by Michael Peter Christen | made triplestore persistent by default added a size display in triplestore servlet Changed Files: defaults/yacy.init, htroot/Triplestore_p.html, htroot/Triplestore_p.java |
Fri Jun 15 14:32:16 CEST 2012 by cominch | Augmented browsing: Add overlay bar which shows the vocabulary tags Changed Files: htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/OverlayInteraction.java, source/net/yacy/interaction/AugmentHtmlStream.java |
Fri Jun 15 11:54:33 CEST 2012 by Michael Peter Christen | renamed "augmented proxy" to "augmented browsing" Changed Files: htroot/ConfigPortal.html, htroot/yacysearchitem.html |
Fri Jun 15 10:46:19 CEST 2012 by cominch | add missing files for tag display Changed Files: htroot/env/templates/interactionheader.template, htroot/interaction_elements/Tag_part.html, htroot/interaction_elements/Tag_part.java, htroot/interaction_elements/tag.png |
Fri Jun 15 10:44:12 CEST 2012 by cominch | Merge remote-tracking branch 'original yacy/master' Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java |
Fri Jun 15 10:43:05 CEST 2012 by cominch | Show tags in search results (if activated in ConfigPortal_p.html) Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/interaction/Triple.java, htroot/interaction_elements/interaction.js, htroot/yacysearch.html, htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/cora/lod/JenaTripleStore.java |
Fri Jun 15 02:43:55 CEST 2012 by Michael Peter Christen | create new vocabularies also without an objectspace. this creates an empty vocabulary Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java |
Thu Jun 14 19:55:34 CEST 2012 by Michael Peter Christen | - fixed Cache link (below snippet) - added 'Augmented Proxy' link below snippet - added configuration options for augmented proxy Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/Vocabulary_p.java, htroot/yacysearchitem.html, htroot/yacysearchitem.java |
Thu Jun 14 19:11:19 CEST 2012 by Michael Peter Christen | added api icon to triplestore Changed Files: htroot/Triplestore_p.html |
Thu Jun 14 18:50:35 CEST 2012 by Michael Peter Christen | added objectlink generation to vocabulary generation and editor Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Document.java |
Thu Jun 14 18:14:45 CEST 2012 by Michael Peter Christen | check also delete triplestore by default Changed Files: htroot/IndexControlRWIs_p.html |
Thu Jun 14 17:41:45 CEST 2012 by cominch | Cleanup of interaction class and helper routines Changed Files: htroot/interaction/Table.java, htroot/interaction/Table.json, htroot/interaction/Triple.java, htroot/interaction/Triple.json, source/net/yacy/interaction/Interaction.java |
Thu Jun 14 15:44:27 CEST 2012 by cominch | Triplestore: modify routines to access per user store Changed Files: htroot/interaction/Triple.java, source/net/yacy/cora/lod/JenaTripleStore.java |
Thu Jun 14 11:46:53 CEST 2012 by cominch | Triplestore: initalize per-user triplestores Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/search/Switchboard.java, source/net/yacy/yacy.java |
Thu Jun 14 09:45:57 CEST 2012 by Michael Peter Christen | refactoring (Localization -> Location) Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocation.java, source/net/yacy/document/geolocalization/OpenGeoDBLocation.java, source/net/yacy/document/geolocalization/OverarchingLocation.java |
Wed Jun 13 15:53:18 CEST 2012 by Michael Peter Christen | - added automated generation of vocabularies from url stubs - added clear of all terms for vocabularies - added deletion of vocabularies Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/search/index/Segment.java |
Wed Jun 13 13:05:41 CEST 2012 by Michael Peter Christen | The 'Locale' vocabulary, which is generated by geo data, has now the objectspace "http://dbpedia.org/resource/" Changed Files: htroot/Vocabulary_p.html, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java |
Wed Jun 13 12:12:20 CEST 2012 by Michael Peter Christen | added a vocabulary editor Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuSemantic.template, source/net/yacy/cora/lod/vocabulary/Tagging.java |
Mon Jun 11 02:37:52 CEST 2012 by reger | adjusted classpath for lib/arq-2.8.7.jar lib/htmllexer.jar lib/htmlparser.jar lib/iri-0.8.jar lib/jena-2.6.4.jar lib/sax-2.0.1.jar Changed Files: nbproject/project.xml |
Tue Jun 12 02:12:01 CEST 2012 by Michael Peter Christen | moved new servlets into one submenu "Content Semantic" Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsing_p.html, htroot/AugmentedParsing_p.html, htroot/DictionaryLoader_p.html, htroot/Triple_p.html, htroot/Triplestore_p.html, htroot/env/templates/header.template, htroot/env/templates/submenuConfig.template, htroot/env/templates/submenuSemantic.template |
Tue Jun 12 01:54:36 CEST 2012 by Michael Peter Christen | added option to clean the triplestore when deleting the index Changed Files: htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, source/net/yacy/cora/lod/JenaTripleStore.java |
Tue Jun 12 01:42:58 CEST 2012 by Michael Peter Christen | allow multiple parser options instead of printing an error Changed Files: source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java |
Tue Jun 12 00:20:11 CEST 2012 by Michael Peter Christen | proper namespaces in triplestore dump Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java |
Mon Jun 11 09:22:45 CEST 2012 by cominch | augmented browsing: remove non-existing external snippet file Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java |
Mon Jun 11 08:07:53 CEST 2012 by cominch | preparation and generalization of augmented browsing methods Changed Files: htroot/interaction_elements/interaction.js, htroot/interaction_elements/interaction_metadata.js, source/net/yacy/interaction/AugmentHtmlStream.java |
Mon Jun 11 09:22:45 CEST 2012 by cominch | augmented browsing: remove non-existing external snippet file Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java |
Mon Jun 11 08:07:53 CEST 2012 by cominch | preparation and generalization of augmented browsing methods Changed Files: htroot/interaction_elements/interaction.js, htroot/interaction_elements/interaction_metadata.js, source/net/yacy/interaction/AugmentHtmlStream.java |
Mon Jun 11 02:37:52 CEST 2012 by reger | adjusted classpath for lib/arq-2.8.7.jar lib/htmllexer.jar lib/htmlparser.jar lib/iri-0.8.jar lib/jena-2.6.4.jar lib/sax-2.0.1.jar Changed Files: nbproject/project.xml |
Mon Jun 11 01:20:54 CEST 2012 by Michael Peter Christen | close the reader if finished Changed Files: source/net/yacy/kelondro/blob/HeapReader.java |
Mon Jun 11 00:38:02 CEST 2012 by Michael Peter Christen | added missing blacklist dht cache storage (maybe due to mistakes in cherry picking) Changed Files: source/net/yacy/repository/Blacklist.java, source/net/yacy/search/Switchboard.java |
Wed May 30 16:57:54 CEST 2012 by Roland 'Quix0r' Haeder | Fix to make all values lower-case (this should make all existing blacklists compatible with the new enum) Changed Files: source/net/yacy/repository/Blacklist.java |
Sun Jun 10 23:40:07 CEST 2012 by Roland 'Quix0r' Haeder | One is okay ... Conflicts: htroot/Trails.html Changed Files: htroot/Trails.html |
Sun Jun 10 23:38:41 CEST 2012 by Roland 'Quix0r' Haeder | Scroogle is not comming back, remove dead code Conflicts: source/net/yacy/search/Switchboard.java Changed Files: defaults/yacy.init, htroot/ConfigHeuristics_p.html, htroot/ConfigHeuristics_p.java, htroot/ConfigNetwork_p.java, source/net/yacy/search/Switchboard.java |
Sun Jun 10 23:17:21 CEST 2012 by Michael Peter Christen | removed usage of deprecated methods Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/interaction/TripleStore.java |
Sun Jun 10 21:54:30 CEST 2012 by Michael Peter Christen | do not load the "_triplestore.rdf" files which are of special use in sciencenet Changed Files: source/net/yacy/yacy.java |
Sun Jun 10 21:49:02 CEST 2012 by Michael Peter Christen | load all - but not the persistent local.rdf - triples from DATA/TRIPLESTORE at startup time. The local.rdf is loaded only if the persistent switch is on (as before). Changed Files: htroot/Triple_p.java, source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java |
Sun Jun 10 13:17:23 CEST 2012 by Michael Peter Christen | removed autocrawler and feedback servlet link since that was not cherry-picked Changed Files: htroot/env/templates/header.template |
Sun Jun 10 13:11:54 CEST 2012 by cominch | bugfix Conflicts: source/net/yacy/document/parser/augment/AugmentParser.java Changed Files: source/net/yacy/document/Document.java, source/net/yacy/search/query/RWIProcess.java |
Sun Jun 10 13:10:21 CEST 2012 by cominch | augmentation Conflicts: source/net/yacy/interaction/AugmentHtmlStream.java Changed Files: htroot/interaction/Sidepanel_part.html, source/net/yacy/interaction/AugmentHtmlStream.java |
Wed May 30 17:11:31 CEST 2012 by cominch | interaction javascript Changed Files: htroot/api/getpageinfo.java, htroot/api/getpageinfo.json, htroot/api/getpageinfo.xml, htroot/interaction/interaction_metadata.js |
Sun Jun 10 13:07:57 CEST 2012 by cominch | augmented browsing modification Conflicts: htroot/interaction/OverlayInteraction.html source/net/yacy/interaction/AugmentHtmlStream.java Changed Files: htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayReview.html, htroot/interaction/OverlayReview.java, htroot/interaction/formdata.js, htroot/interaction/interaction_sciety.js, source/net/yacy/interaction/AugmentHtmlStream.java |
Wed May 16 15:05:17 CEST 2012 by cominch | re-enable augmented proxy Changed Files: source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/interaction/AugmentHtmlStream.java |
Sun Jun 10 13:03:56 CEST 2012 by cominch | bugfix Conflicts: source/net/yacy/interaction/AugmentHtmlStream.java Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java |
Wed May 16 09:23:44 CEST 2012 by cominch | small change Changed Files: htroot/interaction/Suggest.html |
Wed May 16 09:22:55 CEST 2012 by cominch | RDF demo servlet Changed Files: htroot/DemoServletRDF.html, htroot/DemoServletRDF.java, htroot/interaction/PutRDF.java, htroot/interaction/PutRDF.json, htroot/js/rdf/jquery.rdfquery.core-1.0.js |
Sun Jun 10 13:02:00 CEST 2012 by cominch | small changes Conflicts: source/net/yacy/document/parser/augment/AugmentParser.java source/net/yacy/interaction/Interaction.java Changed Files: source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/interaction/Interaction.java |
Mon Mar 12 11:45:27 CET 2012 by cominch | prepare RDF dump routines Changed Files: htroot/interaction/GetRDF.java, htroot/interaction/GetRDF.json, htroot/interaction/GetRDF.xml |
Sun Jun 10 12:58:29 CEST 2012 by cominch | Updated Demo Servlet Conflicts: htroot/About.html htroot/DemoServlet.html htroot/DemoServlet.java htroot/interaction/interaction.js source/net/yacy/interaction/Interaction.java Changed Files: htroot/DemoServlet.html, htroot/DemoServlet.java, htroot/interaction/UploadSingleFile.html, htroot/interaction/UploadSingleFile.java, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java, source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java |
Sun Jun 10 12:49:36 CEST 2012 by cominch | Added config switches for custom parser Conflicts: source/net/yacy/document/TextParser.java Changed Files: defaults/yacy.init, htroot/AugmentedParsing_p.html, htroot/AugmentedParsing_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuAugmentedParsing.template, source/net/yacy/document/TextParser.java |
Fri Feb 24 17:02:57 CET 2012 by cominch | Catch malformed URL when submitted in encoded style Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java |
Fri Feb 24 16:09:44 CET 2012 by cominch | Add a global value store Changed Files: htroot/interaction/Table.java, htroot/interaction/interaction.js |
Sun Jun 10 12:43:01 CEST 2012 by cominch | interaction: add special table interaction Conflicts: source/net/yacy/interaction/Interaction.java Changed Files: source/net/yacy/interaction/Interaction.java |
Sun Jun 10 12:41:16 CEST 2012 by cominch | interaction: add special table interaction Conflicts: source/net/yacy/interaction/Interaction.java Changed Files: htroot/DemoServletInteraction.html, htroot/interaction/OverlayInteraction.html, htroot/interaction/Table.java, htroot/interaction/Table.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java |
Sun Jun 10 12:39:27 CEST 2012 by cominch | interaction: add global variable store Conflicts: source/net/yacy/interaction/Interaction.java Changed Files: source/net/yacy/interaction/Interaction.java |
Sun Jun 10 12:34:36 CEST 2012 by cominch | interaction: add global variable store Conflicts: source/net/yacy/interaction/Interaction.java Changed Files: htroot/DemoServletInteraction.html, htroot/interaction/Triple.java, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java |
Sun Jun 10 12:31:49 CEST 2012 by cominch | create virtual web folder /currentyacypeer/ which always points to local peer, even when using the urlproxy Conflicts: source/de/anomic/http/server/HTTPDProxyHandler.java Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/http/server/HTTPDProxyHandler.java |
Sun Jun 10 12:28:50 CEST 2012 by cominch | Add tagging overlay element Conflicts: htroot/env/templates/jqueryheader.template htroot/yacysearchitem.java source/net/yacy/interaction/Interaction.java Changed Files: htroot/DemoServletInteraction.html, htroot/env/templates/jqueryheader.template, htroot/interaction/OverlayInteraction.html, htroot/interaction/Triple.java, htroot/yacysearchitem.java, source/net/yacy/interaction/Interaction.java |
Sun Jun 10 10:56:39 CEST 2012 by cominch | Small fix Conflicts: htroot/yacysearchitem.java Changed Files: htroot/yacysearchitem.java |
Sun Jun 10 10:55:00 CEST 2012 by cominch | Add Triplestore settings functionality Conflicts: htroot/env/templates/header.template Changed Files: htroot/Triple_p.csv, htroot/Triple_p.html, htroot/Triplestore_p.html, htroot/Triplestore_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuTriplestore.template |
Sun Jun 10 10:53:30 CEST 2012 by cominch | Add new demonstration module for client-side key-value store (backend: triplestore): /DemoServletInteraction.html Conflicts: source/net/yacy/interaction/Interaction.java Changed Files: htroot/DemoServletInteraction.html, htroot/DemoServletInteraction.java, htroot/interaction/Triple.java, htroot/interaction/Triple.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java |
Sun Jun 10 10:51:53 CEST 2012 by cominch | Demonstration: include value from interaction in search results Conflicts: htroot/interaction/OverlayInteraction.html htroot/yacysearchitem.java Changed Files: htroot/Triple_p.html, htroot/Triple_p.java, htroot/interaction/OverlayInteraction.html, htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/interaction/Interaction.java |
Tue Feb 14 15:51:20 CET 2012 by cominch | Small changes Changed Files: htroot/interaction/Triple.java, source/de/anomic/http/server/HTTPDFileHandler.java |
Sun Jun 10 10:38:54 CEST 2012 by cominch | add interaction for triples and selector for augmented browsing Conflicts: htroot/interaction/interaction.js source/net/yacy/interaction/Interaction.java Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsingFilters_p.java, htroot/interaction/OverlayInteraction.html, htroot/interaction/Triple.java, htroot/interaction/Triple.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java |
Mon Feb 13 18:04:22 CET 2012 by cominch | Allow TripleStore to be persistent after reboot Changed Files: source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java |
Sun Jun 10 10:29:15 CEST 2012 by cominch | augmented browsing: ignore js and css, integrate more user interaction Conflicts: htroot/interaction/Footer.html source/net/yacy/interaction/AugmentHtmlStream.java Changed Files: htroot/interaction/Footer.html, htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayInteraction.java, source/net/yacy/interaction/AugmentHtmlStream.java |
Sun Jun 10 10:23:35 CEST 2012 by cominch | augmentedParser add features and integrate external html parser to modify existing web pages Conflicts: addon/YaCy.app/Contents/Info.plist build.xml Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/htmllexer.jar, lib/htmlparser.jar, source/de/anomic/http/server/ServerSideIncludes.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/yacy.java |
Sun Jun 10 10:15:34 CEST 2012 by cominch | augmentedProxy, which forwards every proxy request to a rewrite engine to customize existing webpages. originally implemented by Florian Richter. Conflicts: source/de/anomic/http/server/HTTPDProxyHandler.java Changed Files: htroot/robots.java, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/kelondro/blob/ArrayStack.java |
Thu Jan 19 14:24:17 CET 2012 by cominch | Add menu entries for urlproxy / augmented browsing Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsingFilters_p.java, htroot/AugmentedBrowsing_p.html, htroot/AugmentedBrowsing_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuAugmentation.template |
Wed Jan 18 10:14:33 CET 2012 by cominch | add json mimetype Changed Files: defaults/httpd.mime |
Sat Jun 09 11:00:33 CEST 2012 by Michael Peter Christen | using utf8 String compression in Webstructure database Changed Files: source/net/yacy/kelondro/util/FileUtils.java, source/net/yacy/peers/graphics/WebStructureGraph.java |
Sat Jun 09 10:07:11 CEST 2012 by Michael Peter Christen | saved a bit more ram using UTF8 String compression for OpenGeoDB and Geonames data files. Changed Files: source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/search/Switchboard.java |
Sat Jun 09 09:46:27 CEST 2012 by Michael Peter Christen | made the GeoLocation into an interface with the current integer implementation as accuracy implementation of 1.863cm Changed Files: source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/GeoPoint.java, source/net/yacy/document/geolocalization/IntegerGeoPoint.java |
Sat Jun 09 09:10:54 CEST 2012 by Michael Peter Christen | added location search to main menu Changed Files: htroot/env/templates/header.template |
Sat Jun 09 09:05:47 CEST 2012 by Michael Peter Christen | - changed initialization order to prefer allocation of memory for table files first - bugfixes in memory amount calculation Changed Files: source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java |
Fri Jun 08 18:36:11 CEST 2012 by Michael Peter Christen | only the metadata tables shall be able to use the tail cache Changed Files: source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java |
Fri Jun 08 12:48:25 CEST 2012 by Michael Peter Christen | - less restrictions for usage of Table RAM copy - new limit to use the table copy (instead of flag): 400MB available. If less is available, then a copy is never used. If more is available, then it can be used if there is a remaining space of at least 200MB - flush caches more often: flush the Digest cache Changed Files: defaults/yacy.init, source/net/yacy/kelondro/order/Digest.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/MetadataRepository.java |
Fri Jun 08 09:48:46 CEST 2012 by Michael Peter Christen | bugfix: do not switch off standard memory strategy when performing a forced GC PLEASE CHECK if your peer has standard memory switched on! Changed Files: htroot/PerformanceMemory_p.java |
Fri Jun 08 09:41:29 CEST 2012 by Michael Peter Christen | lazy initialization of block rank table ... only normal web search uses this. When interactive search or location search is used, the block rank is switched off Changed Files: htroot/index.java, htroot/yacyinteractive.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/search/ranking/BlockRank.java |
Fri Jun 08 09:30:51 CEST 2012 by Michael Peter Christen | lazy initialization of database tables Changed Files: source/net/yacy/kelondro/blob/Tables.java |
Fri Jun 08 09:14:54 CEST 2012 by Michael Peter Christen | fixed RWIProcess queue limits: now discovering hidden results for mass result retrieval Changed Files: htroot/IndexControlRWIs_p.java, source/net/yacy/cora/services/federated/SearchResult.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java |
Fri Jun 08 09:13:41 CEST 2012 by Michael Peter Christen | fixed handlemap spread factor and null iterator handling Changed Files: htroot/PerformanceMemory_p.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/index/RAMIndexCluster.java, source/net/yacy/kelondro/order/StackIterator.java, source/net/yacy/kelondro/util/StandardMemoryStrategy.java |
Thu Jun 07 19:42:33 CEST 2012 by Michael Peter Christen | flush the compressor cache when a cleanup is done Changed Files: source/de/anomic/crawler/Cache.java, source/net/yacy/kelondro/blob/Compressor.java, source/net/yacy/search/Switchboard.java |
Thu Jun 07 13:16:38 CEST 2012 by Michael Peter Christen | lazy initialization of block rank table. this causes that the table is not initialized when there is no search is done. the effect is most strong if YaCy is started headless which causes no browser pop-up which otherwise would load the search page and therefore trigger the initialization of the table. Changed Files: htroot/yacyinteractive.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/search/ranking/BlockRank.java |
Thu Jun 07 12:36:26 CEST 2012 by Michael Peter Christen | enhanced hint for debian package automatic update Changed Files: htroot/ConfigUpdate_p.html |
Wed Jun 06 14:27:18 CEST 2012 by Michael Peter Christen | accept also file names beginning with "file://" for crawl start from file. Changed Files: htroot/CrawlStartExpert_p.html, htroot/Crawler_p.java |
Wed Jun 06 14:17:42 CEST 2012 by Michael Peter Christen | use less cache space since a large cache would cause more memory usage in index files. Changed Files: defaults/yacy.init |
Wed Jun 06 14:15:24 CEST 2012 by Michael Peter Christen | added automatic cleaning of cache if metadata and file database size is not equal. It might happen that these data is different because one of that caches is cleaned after a while or when it is too big. The metadata is then not cleaned, but now wiped after a checkup process at every application start. This should cause a bit less memory usage. Changed Files: htroot/ConfigHTCache_p.java, source/de/anomic/crawler/Cache.java, source/net/yacy/kelondro/blob/Compressor.java, source/net/yacy/kelondro/blob/MapHeap.java |
Wed Jun 06 13:36:10 CEST 2012 by Michael Peter Christen | accept also files with other file prefix; used to read 'foreign' cache files Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java |
Wed Jun 06 12:57:42 CEST 2012 by Michael Peter Christen | added GeoLocation / GeoPoint classes which uses less memory than Location/Coordinates and has initializers with correct order of lat,lon coordinates Changed Files: htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/GeoPoint.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/Localization.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/document/geolocalization/OverarchingLocalization.java |
Tue Jun 05 18:29:54 CEST 2012 by Michael Peter Christen | allow more POIs, get more at once Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/net/yacy/cora/services/federated/opensearch/SRURSSConnector.java |
Mon Jun 04 23:44:26 CEST 2012 by Michael Peter Christen | added show from cache in search results (not yet finished) Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.html, htroot/yacysearchitem.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/storage/Files.java |
Mon Jun 04 23:43:30 CEST 2012 by Michael Peter Christen | adopted vocabulary usage within anotation/naviagtion feature of search to new SimpleVocabulary class Changed Files: source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java |
Mon Jun 04 23:41:36 CEST 2012 by Michael Peter Christen | moved Vocabulary to cora package (added in git 964406ad17a461322ab3478e9e832c302a9e9dc5) Changed Files: source/net/yacy/document/Autotagging.java |
Mon Jun 04 23:35:56 CEST 2012 by Michael Peter Christen | added concurrency enhancement to xml parser Changed Files: source/net/yacy/cora/document/RSSReader.java, source/net/yacy/cora/lod/SimpleVocabulary.java, source/net/yacy/document/content/SurrogateReader.java, source/net/yacy/document/importer/OAIListFriendsLoader.java, source/net/yacy/document/importer/ResumptionToken.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/xml/opensearchdescriptionReader.java |
Mon Jun 04 15:34:53 CEST 2012 by Michael Peter Christen | using pre-compile pattern in blacklist; should enhance search speed Changed Files: source/net/yacy/repository/Blacklist.java |
Fri Jun 01 00:08:31 CEST 2012 by Michael Peter Christen | - bugfix for surrogate file reader - bugfix for location search: suppress empty search Changed Files: htroot/yacysearch_location.java, source/net/yacy/document/content/DCEntry.java |
Thu May 31 14:05:36 CEST 2012 by Michael Peter Christen | - added double-buffering for search layers - added automatic zooming to search result to location search Changed Files: htroot/yacysearch_location.html |
Thu May 31 01:12:06 CEST 2012 by Michael Peter Christen | automatically zoom to result layer bounds Changed Files: htroot/yacysearch_location.html |
Thu May 31 00:47:52 CEST 2012 by Michael Peter Christen | - show number of results in map search interface - transfer view radius within query Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java |
Thu May 31 00:47:07 CEST 2012 by Michael Peter Christen | store more data from interface access Changed Files: source/net/yacy/search/query/AccessTracker.java |
Thu May 31 00:46:30 CEST 2012 by Michael Peter Christen | performance hacks Changed Files: source/net/yacy/kelondro/index/Row.java |
Wed May 30 17:14:25 CEST 2012 by Michael Peter Christen | better location to generate a guid for rss messages Changed Files: source/net/yacy/cora/document/RSSMessage.java |
Wed May 30 16:44:03 CEST 2012 by Michael Peter Christen | RSSMessages do not need a concurrent hash map -> removed overhead Changed Files: source/net/yacy/cora/document/RSSMessage.java |
Wed May 30 16:40:37 CEST 2012 by Michael Peter Christen | enhanced RSS parsing by ensuring that it is parsed with a buffered input stream Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/cora/document/RSSReader.java |
Wed May 30 16:26:05 CEST 2012 by Michael Peter Christen | introduced a default 10 second time-out in rwi normalization time uring search process to prevent endless deadlocks after a very long running search Changed Files: source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/ranking/ReferenceOrder.java |
Wed May 30 15:47:35 CEST 2012 by Michael Peter Christen | better logging Changed Files: source/net/yacy/kelondro/logging/Log.java |
Wed May 30 15:42:28 CEST 2012 by Michael Peter Christen | only ASCII needed in seed bitflags Changed Files: source/net/yacy/peers/Seed.java |
Wed May 30 15:28:20 CEST 2012 by Michael Peter Christen | using double instead float for a better release ordering Changed Files: source/net/yacy/peers/operation/yacyRelease.java, source/net/yacy/peers/operation/yacyVersion.java |
Wed May 30 15:27:45 CEST 2012 by Michael Peter Christen | better logging Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/server/serverCore.java, source/net/yacy/kelondro/logging/Log.java, source/net/yacy/kelondro/order/MergeIterator.java, source/net/yacy/kelondro/workflow/InstantBlockingThread.java, source/net/yacy/kelondro/workflow/InstantBusyThread.java |
Wed May 30 10:03:50 CEST 2012 by PCA42 | Windows Installer: update to Oracle Java 7u4 Changed Files: build.nsi |
Wed May 30 09:32:25 CEST 2012 by Michael Peter Christen | added node state to xml Changed Files: htroot/Network.xml |
Tue May 29 12:00:32 CEST 2012 by Michael Peter Christen | added all shell scripts in /bin to add also latest passwd.sh file Changed Files: build.xml |
Tue May 29 02:22:02 CEST 2012 by Michael Peter Christen | removed osmarender from yacysearch_location because that caused a javascript error Changed Files: htroot/yacysearch_location.html |
Tue May 29 01:38:54 CEST 2012 by Michael Peter Christen | - fixes to node identification - added link to node in network list - added marking of portal search node peers Changed Files: htroot/Network.html, htroot/Network.java, htroot/RemoteCrawl_p.java, htroot/yacy/hello.java, source/net/yacy/peers/Seed.java, source/net/yacy/peers/SeedDB.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/peers/operation/yacyVersion.java |
Tue May 29 00:06:33 CEST 2012 by Michael Peter Christen | enhanced RootState icon Changed Files: htroot/env/grafics/RootStateNo.gif, htroot/env/grafics/RootStateYes.gif |
Fri May 25 17:29:54 CEST 2012 by Michael Peter Christen | added node state icon in network list Changed Files: htroot/Network.html, htroot/Network.java, htroot/env/grafics/RootStateNo.gif, htroot/env/grafics/RootStateYes.gif, source/net/yacy/peers/Seed.java |
Fri May 25 15:33:02 CEST 2012 by Michael Peter Christen | added a root node flag: identifies peers with short ping time Changed Files: source/net/yacy/peers/Protocol.java, source/net/yacy/peers/Seed.java |
Fri May 25 01:45:38 CEST 2012 by Michael Peter Christen | redesign of the crawler monitor page: show crawled pages instead of queue of urls that shall be crawled Changed Files: htroot/Crawler_p.html, htroot/env/templates/submenuCrawlMonitor.template, htroot/js/Crawler.js, source/net/yacy/cora/document/RSSMessage.java, source/net/yacy/search/Switchboard.java |
Wed May 23 18:00:37 CEST 2012 by Michael Peter Christen | Added more steering in Crawler_p.html interface Changed Files: htroot/CrawlProfileEditor_p.java, htroot/Crawler_p.html, htroot/Crawler_p.java, source/de/anomic/crawler/CrawlProfile.java |
Wed May 23 15:45:07 CEST 2012 by Michael Peter Christen | hack against 100% cpu during crawl delete Changed Files: source/de/anomic/crawler/Balancer.java |
Mon May 21 02:27:06 CEST 2012 by Michael Peter Christen | removed stack trace from swf parser since we cant do anything there Changed Files: source/net/yacy/document/parser/swfParser.java |
Mon May 21 01:58:29 CEST 2012 by Michael Peter Christen | - fixed image search page navigation - removed some deadlocks and ConcurrentModificationExceptions during DidYouMean collection Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, htroot/yacysearchlatestinfo.java, source/net/yacy/search/query/QueryParams.java |
Mon May 21 00:59:41 CEST 2012 by Michael Peter Christen | added more interruptions in DidYouMean because that was the cause for some blockings during search Changed Files: source/de/anomic/data/DidYouMean.java |
Mon May 21 00:58:29 CEST 2012 by Michael Peter Christen | synchronization needed Changed Files: source/net/yacy/kelondro/index/RAMIndex.java |
Mon May 21 00:19:03 CEST 2012 by Michael Peter Christen | changed queue sizes to have less memory occupied during indexing Changed Files: source/net/yacy/search/Switchboard.java |
Mon May 21 00:18:00 CEST 2012 by Michael Peter Christen | bugfix for http://bugs.yacy.net/view.php?id=173 Changed Files: source/net/yacy/search/snippet/TextSnippet.java |
Sun May 20 05:25:16 CEST 2012 by reger | bugfix: lookup of peernames no result for active peer in page IndexControlRWIs_p.html -> Transfer RWI to other Peer SeedDB.lookupByName searche for lowercase peerNames, while MapColumnIndex.getIndex uses peername as is in the keyset. Changed the index init to insert lowercase peer names as key Changed Files: htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, source/net/yacy/kelondro/blob/MapColumnIndex.java |
Sun May 20 00:50:54 CEST 2012 by Michael Peter Christen | relax verify attribute for search widget to make it faster: set to "cacheonly" Changed Files: defaults/yacy.init, htroot/ConfigLiveSearch.html, htroot/ConfigSearchBox.html, htroot/Load_PHPBB3.html, htroot/env/templates/portalinput.template, htroot/portalsearch/yacy-portalsearch.html |
Sat May 19 02:09:16 CEST 2012 by reger | correct typo in scripts_txt comment Changed Files: source/net/yacy/search/index/SolrField.java |
Fri May 18 22:33:41 CEST 2012 by Michael Peter Christen | moved files to defaults Changed Files: build.xml |
Fri May 18 22:33:16 CEST 2012 by Michael Peter Christen | the last commit was incomplete.. Changed Files: source/net/yacy/cora/protocol/Domains.java, source/net/yacy/search/Switchboard.java |
Thu May 17 11:08:48 CEST 2012 by Michael Peter Christen | small speed enhancement using a column factory Changed Files: source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/RowCollection.java |
Thu May 17 06:03:18 CEST 2012 by Roland 'Quix0r' Haeder | More sync in close() methods Conflicts: source/net/yacy/kelondro/logging/GuiHandler.java source/net/yacy/kelondro/workflow/InstantBusyThread.java Changed Files: source/net/yacy/kelondro/logging/GuiHandler.java, source/net/yacy/kelondro/workflow/InstantBusyThread.java, source/net/yacy/search/index/DocumentMetadata.java, source/net/yacy/search/index/DocumentReference.java |
Thu May 17 06:00:49 CEST 2012 by Roland 'Quix0r' Haeder | With or without 'final'? At least please try it in other methods Conflicts: source/de/anomic/tools/tarTools.java Changed Files: source/de/anomic/tools/tarTools.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/search/index/DocumentMetadata.java |
Tue May 15 20:57:38 CEST 2012 by Roland 'Quix0r' Haeder | Made a method static (Eclipse suggested it), removed unused import, pk=null check does now output a warning in logfile Changed Files: htroot/Banner.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/index/SolrConfiguration.java |
Thu May 17 05:49:25 CEST 2012 by Roland 'Quix0r' Haeder | No & in JavaScript-embeded URLs, added ability to stop focus in ConfigPortal.html preview (is this not secured with _p????) Conflicts: htroot/yacyinteractive.java htroot/yacysearch.java Changed Files: htroot/index.html, htroot/yacyinteractive.java, htroot/yacysearch.html, htroot/yacysearch.java |
Thu May 17 05:18:52 CEST 2012 by Michael Peter Christen | prevent that the snippet fectch process removes catchall entries Changed Files: source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/SnippetProcess.java |
Thu May 17 04:26:03 CEST 2012 by Michael Peter Christen | moved yacy.logging to defaults according to request in http://bugs.yacy.net/view.php?id=55 Changed Files: defaults/yacy.logging, source/net/yacy/yacy.java |
Thu May 17 03:55:10 CEST 2012 by Michael Peter Christen | Pattern.quote() replaces \\Q and \\E according to publication in http://www.cs.washington.edu/homes/mernst/pubs/regex-types-ftfjp2012.pdf Changed Files: htroot/Load_RSS_p.java, source/de/anomic/data/ymark/YMarkCrawlStart.java, source/de/anomic/data/ymark/YMarkTables.java |
Wed May 16 10:14:44 CEST 2012 by Michael Peter Christen | typo Changed Files: htroot/IndexFederated_p.html |
Wed May 16 01:04:08 CEST 2012 by Michael Peter Christen | ups Changed Files: defaults/yacy.init |
Tue May 15 23:10:47 CEST 2012 by Michael Peter Christen | added serialization Changed Files: htroot/IndexFederated_p.html, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/search/index/SolrConfiguration.java |
Tue May 15 12:25:46 CEST 2012 by Michael Peter Christen | added configuration to switch off redirection following in crawler Changed Files: defaults/yacy.init, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/net/yacy/search/SwitchboardConstants.java |
Tue May 15 12:24:54 CEST 2012 by Michael Peter Christen | enhanced crawler/balancer: better remaining waiting-time guessing Changed Files: source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/Latency.java |
Sat May 12 10:39:01 CEST 2012 by Michael Peter Christen | made multiple connector default Changed Files: htroot/IndexFederated_p.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/search/Switchboard.java |
Sat May 12 10:32:42 CEST 2012 by Michael Peter Christen | - enhanced the solr connector - added new multiple connector (to replace singleConnector) Changed Files: source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrMultipleConnector.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java |
Fri May 11 20:46:50 CEST 2012 by Michael Peter Christen | more tolerance in case of corrupted file Changed Files: source/net/yacy/kelondro/table/Table.java |
Fri May 11 11:33:05 CEST 2012 by Michael Peter Christen | moved debian dependency to openjdk-7 Changed Files: debian/control |
Fri May 11 00:40:56 CEST 2012 by reger | Adjust NetBeans config to use lib/solr-3.6.jar Changed Files: nbproject/project.xml |
Wed May 09 23:43:12 CEST 2012 by Michael Peter Christen | added missing classes for solr interface Changed Files: source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java |
Wed May 09 17:21:19 CEST 2012 by Michael Peter Christen | better abstraction for solr objects Changed Files: source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingSelection.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/index/SolrConfiguration.java |
Wed May 09 17:00:56 CEST 2012 by Michael Peter Christen | more abstraction in solr connection classes Changed Files: htroot/IndexFederated_p.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java |
Wed May 09 12:28:43 CEST 2012 by Michael Peter Christen | enhancement in circle drawing Changed Files: source/net/yacy/visualization/CircleTool.java |
Tue May 08 23:24:39 CEST 2012 by Michael Peter Christen | less 'wellformed' calls without asserts Changed Files: source/net/yacy/kelondro/index/Row.java |
Tue May 08 20:07:34 CEST 2012 by Marc Nause | *) better formatting for network QPM *) refactoring Changed Files: htroot/Banner.java, source/net/yacy/peers/graphics/Banner.java, source/net/yacy/peers/graphics/BannerData.java, source/net/yacy/peers/graphics/NetworkGraph.java |
Mon May 07 00:54:00 CEST 2012 by Michael Peter Christen | removed superfluous column Changed Files: htroot/IndexCreateQueues_p.html, htroot/IndexCreateQueues_p.java |
Mon Apr 30 11:09:54 CEST 2012 by Michael Peter Christen | removed superfluous files Changed Files: addon/yacy-svn-4.spec, build.xml |
Sun Apr 29 21:22:23 CEST 2012 by Michael Peter Christen | Merge remote branch 'bbyacy-rc1/master' Changed Files: htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearch.rss |
Sun Apr 29 21:21:49 CEST 2012 by Michael Peter Christen | Merge commit 'c1f6b4fb5226d3d2f8b2bec9e361f6b3476e03ff' Changed Files: source/net/yacy/peers/SeedDB.java |
Sun Apr 29 05:50:56 CEST 2012 by reger | changed link to opensearchdescription document to a absolute uri (in yacysearch.html and yacysearch.rss) see http://www.opensearch.org/Specifications/OpenSearch/1.1/Draft_5#The_.22Description.22_element Changed Files: htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearch.rss |
Fri Apr 27 18:26:36 CEST 2012 by Michael Peter Christen | removed methods not supported by new solrj connector for httpclient 4 Error was: java.lang.UnsupportedOperationException: Client was created outside of HttpSolrServer at org.apache.solr.client.solrj.impl.HttpSolrServer.setDefaultMaxConnectionsPerHost(HttpSolrServer.java:614) at net.yacy.cora.services.federated.solr.SolrSingleConnector.<init>(SolrSingleConnector.java:128) at net.yacy.cora.services.federated.solr.SolrShardingConnector.<init>(SolrShardingConnector.java:55) at net.yacy.search.Switchboard.<init>(Switchboard.java:657) at net.yacy.yacy.startup(yacy.java:222) at net.yacy.yacy.main(yacy.java:1018) Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java |
Fri Apr 27 17:48:51 CEST 2012 by Michael Peter Christen | added new entry class for embed tags Changed Files: source/net/yacy/document/parser/html/EmbedEntry.java |
Fri Apr 27 17:46:08 CEST 2012 by Michael Peter Christen | - fixed build problems (deprecated methods using httpclient 3.1) - removed httpclient 3.1 lib which was used by solrj (solrj now uses httpclient 4) Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, source/net/yacy/cora/protocol/http/HTTPClient.java, source/net/yacy/cora/services/federated/solr/SolrHTTPClient.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java |
Fri Apr 27 17:20:18 CEST 2012 by Michael Peter Christen | concurrency enhancement in ConfigurationSet Changed Files: source/net/yacy/cora/storage/ConfigurationSet.java |
Fri Apr 27 16:48:51 CEST 2012 by Michael Peter Christen | - solved problems with backpath normalization - redesigned in/outbound link handover - removed iframe links from inbound/outbound in solr scheme Changed Files: htroot/api/webstructure.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/document/Document.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/search/index/Segment.java |
Fri Apr 27 11:22:34 CEST 2012 by Michael Peter Christen | updated solrj lib Changed Files: .classpath, lib/apache-solr-solrj-3.6.0.License, lib/apache-solr-solrj-3.6.0.jar |
Thu Apr 26 15:25:07 CEST 2012 by Michael Peter Christen | - enhanced solr field documentation - added xml api button to IndexFederated_p - the solr schema.xml file can be generated by YaCy Changed Files: htroot/IndexFederated_p.html, htroot/IndexFederated_p.java, htroot/Network.html, htroot/api/schema_p.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java |
Thu Apr 26 00:27:21 CEST 2012 by Michael Peter Christen | hack to get all results if the actual number is between 10 and 64 Changed Files: htroot/js/yacyinteractive.js |
Thu Apr 26 00:23:18 CEST 2012 by Michael Peter Christen | - apply directDocByURL to NOLOAD Queue - choose pushing to NOLOAD as default for site crawl Changed Files: htroot/CrawlStartSite_p.html, htroot/Crawler_p.java, source/net/yacy/search/Switchboard.java |
Tue Apr 24 16:04:13 CEST 2012 by Michael Peter Christen | increased image preview size Changed Files: htroot/env/base.css, htroot/yacysearchitem.html |
Tue Apr 24 12:55:58 CEST 2012 by Michael Peter Christen | changed search process for images: no more media snippet load process, show only links from index which had been on the text search page before. This creates a superfast search process for images! Changed Files: htroot/ViewFile.java, htroot/yacysearchitem.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java |
Tue Apr 24 12:54:41 CEST 2012 by Michael Peter Christen | refactoring Changed Files: source/de/anomic/crawler/Cache.java, source/de/anomic/http/server/HTTPDProxyHandler.java |
Tue Apr 24 12:05:37 CEST 2012 by Michael Peter Christen | one more scroogle... Changed Files: htroot/yacysearch.java |
Tue Apr 24 12:04:44 CEST 2012 by Michael Peter Christen | removed scroogle parser Changed Files: htroot/yacysearch.java |
Tue Apr 24 00:05:01 CEST 2012 by reger | lookupByIP: prevent comparing of port parameter if called with port -1 (=unknown) Changed Files: source/net/yacy/peers/SeedDB.java |
Sat Apr 21 21:32:31 CEST 2012 by Michael Peter Christen | removed dependency from logging Changed Files: source/net/yacy/cora/document/Classification.java |
Sat Apr 21 21:31:13 CEST 2012 by Michael Peter Christen | refactoring: moved document Classification to cora package Changed Files: source/de/anomic/crawler/retrieval/FileLoader.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/crawler/retrieval/SMBLoader.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/document/Document.java, source/net/yacy/document/TextParser.java, source/net/yacy/search/snippet/MediaSnippet.java |
Sat Apr 21 13:47:48 CEST 2012 by Michael Peter Christen | refactoring: removed dependency from switchboard in Balancer/CrawlQueues Changed Files: htroot/IndexCreateQueues_p.java, htroot/yacy/urls.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/Latency.java, source/de/anomic/crawler/NoticedURL.java |
Thu Apr 19 13:29:08 CEST 2012 by Michael Peter Christen | no more SVN Changed Files: htroot/RemoteCrawl_p.html |
Thu Apr 19 13:28:12 CEST 2012 by Michael Peter Christen | no more SVN.. Changed Files: htroot/Network.html |
Thu Apr 19 12:35:11 CEST 2012 by Michael Peter Christen | one more warning in case that crawling is paused because of low disk space Changed Files: htroot/Status.html, htroot/Status.java |
Thu Apr 19 11:50:24 CEST 2012 by Michael Peter Christen | 'download' Changed Files: htroot/env/templates/submenuConfig.template |
Thu Apr 19 11:49:43 CEST 2012 by Michael Peter Christen | update location update Changed Files: defaults/yacy.network.allip.unit, defaults/yacy.network.freeworld.unit, defaults/yacy.network.intranet.unit, defaults/yacy.network.metager.unit, defaults/yacy.network.webportal.unit |
Thu Apr 19 11:11:14 CEST 2012 by Michael Peter Christen | add hint to speed up search results Changed Files: htroot/ConfigPortal.html, htroot/env/base.css |
Thu Apr 19 11:10:48 CEST 2012 by Michael Peter Christen | add hint for consulting support Changed Files: htroot/Status.html, htroot/Status.java |
Wed Apr 18 10:30:04 CEST 2012 by Michael Peter Christen | fix for parser problem if a <a>-tag is 'within' html tags with unclosed tags. That prevented the <a> tags from beeing recognized. This is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=25516#p25516 Changed Files: source/net/yacy/document/parser/html/TransformerWriter.java |
Tue Apr 17 12:30:14 CEST 2012 by Michael Peter Christen | display is not used any more Changed Files: htroot/ViewFile.html |
Tue Apr 17 11:22:19 CEST 2012 by Michael Peter Christen | automatic generation of blacklist pattern, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2685&p=25305#p25305 Changed Files: htroot/Blacklist_p.java |
Mon Apr 16 23:43:50 CEST 2012 by Michael Peter Christen | added citation rank to ranking profile Changed Files: htroot/Ranking_p.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/RankingProfile.java |
Mon Apr 16 09:50:55 CEST 2012 by Michael Peter Christen | check if httpc has decompressed the release file and rename the file from .tar.gz to .tar if that happened Changed Files: source/de/anomic/tools/tarTools.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/peers/operation/yacyRelease.java |
Mon Apr 16 04:00:04 CEST 2012 by reger | remove heuristic scroogle from search option help text in index.html Changed Files: htroot/index.html |
Fri Apr 13 11:53:34 CEST 2012 by Michael Christen | extended webstructure api to show together with incoming links also outgoing links Changed Files: htroot/api/webstructure.java, htroot/api/webstructure.xml |
Fri Apr 13 06:47:33 CEST 2012 by Michael Christen | experimental implementation of a citation ranking as post-ranking method. (ranking coefficient fixed, need to be made configurable) Changed Files: source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ResultEntry.java |
Sat Mar 31 07:38:49 CEST 2012 by Michael Christen | added information about inbound, outbound and citation links into yacydoc api servlet Changed Files: htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml |
Thu Mar 29 17:22:31 CEST 2012 by Michael Christen | added an api to retrieve the new citation.index with the webstructure.xml api. This api will respond with details about a single URL if requested with 'webstructure.xml?about=[url|urlhash|host]'. Changed Files: htroot/api/webstructure.java, htroot/api/webstructure.xml |
Thu Mar 29 17:20:14 CEST 2012 by Michael Christen | added storage of full anchor link structure: the links between all pages are now stored. The same index structure as used for the word index is used to make a reverse link index. The new file(s) in SEGMENT/default/citation.index.*.blob store the citation index. This will be used to create much more detailed link structures for the YaCy apis and to create a better ranking. A ranking using the citation.index should provide better results especially for portal indexes and initranets. Changed Files: source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/Segments.java |
Wed Mar 28 21:50:00 CEST 2012 by Michael Christen | fixed default must-match filter for full domain crawls - the old filter was to restrictive and did not allow intranet crawls Changed Files: source/de/anomic/crawler/CrawlProfile.java, source/de/anomic/crawler/CrawlStacker.java |
Sun Mar 25 22:21:42 CEST 2012 by Lotus | some better feedback on properties change Changed Files: htroot/ConfigProperties_p.html, htroot/ConfigProperties_p.java |
Fri Mar 23 17:02:50 CET 2012 by Lotus | added hint how to change integration options Changed Files: htroot/ConfigPortal.html |
Tue Mar 20 23:00:06 CET 2012 by Thomas | Remove Scroogle from compare-search, Scroogle is dead Changed Files: htroot/compare_yacy.java |
Sat Mar 17 21:10:29 CET 2012 by Lotus | no focus on preview frames for search integration fixes bug http://bugs.yacy.net/view.php?id=161 Changed Files: htroot/ConfigPortal.html, htroot/WatchWebStructure_p.html, htroot/index.html, htroot/index.java, htroot/yacyinteractive.html, htroot/yacyinteractive.java, htroot/yacysearch.html, htroot/yacysearch.java |
Sat Mar 17 20:43:19 CET 2012 by Lotus | allow custom ppm lower than minimum button on /Crawler_p.html fixes http://bugs.yacy.net/view.php?id=166 Changed Files: source/net/yacy/search/Switchboard.java |
Mon Mar 12 09:30:44 CET 2012 by Lotus | checkalive.sh: try to fetch only once (default: 20) Changed Files: bin/checkalive.sh |
Tue Feb 28 13:18:46 CET 2012 by Michael Peter Christen | added physics experiment to the graph plotter. not active by default Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java |
Mon Feb 27 21:27:17 CET 2012 by Michael Peter Christen | better names for elements of a linked graph Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java |
Mon Feb 27 00:52:44 CET 2012 by Michael Peter Christen | bugfix for a must-not-match pattern check. This bug did not make the check semantically wrong, but a trick that prevented an IP lookup in case that the filter was not used did not work. That bugfix causes that crawling gets a huge speed boost for noload urls! Changed Files: source/de/anomic/crawler/CrawlStacker.java |
Sun Feb 26 20:53:32 CET 2012 by Michael Peter Christen | if a new pop-up page is set in config portal, then this page applies also to the default page configuration for the httpd if no path is given. Changed Files: htroot/ConfigBasic.java, htroot/ConfigPortal.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/search/SwitchboardConstants.java |
Sun Feb 26 17:32:45 CET 2012 by Michael Peter Christen | better navigation in file search: less results by first try, but much faster. after the first search is done, buttons appear to get more results for the same search Changed Files: htroot/js/yacyinteractive.js, htroot/yacyinteractive.java |
Sun Feb 26 00:06:57 CET 2012 by reger | adjust Netbeans project class path settings to updated httpclient and commons jars Changed Files: nbproject/project.xml |
Sun Feb 26 00:04:25 CET 2012 by reger | fix: prevent logging of Solr doc content with attached Solr server transfered content is written to log despite log level = off fixed naming of httpclient logger Changed Files: yacy.logging |