Commits

Branch selector

 3.2.0

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 10, 2014

• Merge pull request #26 from nlevitt/release-3.2.0

  Show description for 484b357
  nlevitt

  committed
  484b357

  Copy full SHA for 484b357

• update readme for 3.2.0 release

  nlevitt

  committed
  0467304

  Copy full SHA for 0467304

• Merge pull request #25 from nlevitt/release-3.2.0

  Show description for 752e288
  eldondev

  committed
  752e288

  Copy full SHA for 752e288

• bump version number to 3.2.0 for release

  nlevitt

  committed
  32c083f

  Copy full SHA for 32c083f

Commits on Jan 8, 2014

• Merge pull request #24 from nlevitt/url-agnostic-standard

  Show description for 9ac0ee0
  adam-miller

  committed
  9ac0ee0

  Copy full SHA for 9ac0ee0

Commits on Jan 7, 2014

• for url-agnostic dedup, follow "Proposal for Standardizing the Recording of Arbitrary Duplicates in WARC Files" https://docs.google.com/document/d/1QyQBA7Ykgxie75V8Jziz_O7hbhwf7PF6_u9O6w6zgp0

  nlevitt

  committed
  84e78db

  Copy full SHA for 84e78db

Commits on Dec 18, 2013

• Merge pull request #23 from nlevitt/her-1979

  Show description for 506e683
  ikreymer

  committed
  506e683

  Copy full SHA for 506e683

• fix HER-1979 so heritrix can run on windows xp

  nlevitt

  committed
  7dd67bd

  Copy full SHA for 7dd67bd

Commits on Dec 15, 2013

• useProjectArtifact=false to avoid [WARNING] Cannot include project artifact: ... it doesn't have an associated file or directory

  nlevitt

  committed
  2388a35

  Copy full SHA for 2388a35

• abbreviate maven repository clauses, reduce redundancy, and let default settings prevail, such as updatePolicy=daily, pointed out by Erik Hetzner

  nlevitt

  committed
  0ea1066

  Copy full SHA for 0ea1066

Commits on Dec 12, 2013

• fix report links

  nlevitt

  committed
  6f171b5

  Copy full SHA for 6f171b5

Commits on Dec 7, 2013

• test fix (in ia-web-commons) for HER-2059

  nlevitt

  committed
  3b06c88

  Copy full SHA for 3b06c88

Commits on Dec 6, 2013

• moving a bunch of stuff from heritrix-commons to ia-web-commons so that wayback doesn't have to depend on heritrix-commons

  nlevitt

  committed
  3c8a0a3

  Copy full SHA for 3c8a0a3

• moving org.archive.net.PublicSuffixes to ia-web-commons

  nlevitt

  committed
  98d0901

  Copy full SHA for 98d0901

Commits on Nov 27, 2013

• don't let the exception from commit df2a313797b15d01e3959e309842b25ebb92ca91 derail the whole crawl job

  nlevitt

  committed
  552794d

  Copy full SHA for 552794d

Commits on Nov 22, 2013

• try to avoid nearly endless loop of "java.lang.IllegalStateException: Can't open a cursor Database was closed." when startup fails and dumpPendingToLog is attempted

  nlevitt

  committed
  1163847

  Copy full SHA for 1163847

Commits on Nov 20, 2013

• bump version to 3.2.0-SNAPSHOT since there are some incompatible api changes since 3.1.1 (requested by kris sigurðsson)

  nlevitt

  committed
  8e1125d

  Copy full SHA for 8e1125d

Commits on Nov 19, 2013

• new CrawlURI annotation "duplicate:digest" to simplify handling dups in stats, etc

  nlevitt

  committed
  d93b544

  Copy full SHA for d93b544

Commits on Nov 16, 2013

• remove unused engine.css

  nlevitt

  committed
  7089caf

  Copy full SHA for 7089caf

• Adam's responsive UI

  nlevitt

  committed
  119e565

  Copy full SHA for 119e565

• oops, avoid npe

  nlevitt

  committed
  2b87219

  Copy full SHA for 2b87219

• throw exception when host cache returns 0.0.0.0 for any host (trying to track down a strange problem)

  nlevitt

  committed
  df2a313

  Copy full SHA for df2a313

Commits on Nov 1, 2013

• Merge branch 'master' of github.com:internetarchive/heritrix3

  ikreymer

  committed
  e2f4b72

  Copy full SHA for e2f4b72

• removed ThreadLocalHttpConnectionManager -- it has been moved to ia-web-commons

  ikreymer

  committed
  8633ed0

  Copy full SHA for 8633ed0

Commits on Oct 29, 2013

• Include in checkpoint data a list of ".open" WARCs and their current raw on-disk length, so the exact extent of pre-checkpoint content can be deduced/reconstructed. Also when flushing or closing wr…

  Show description for b137022
  nlevitt

  committed
  b137022

  Copy full SHA for b137022

Commits on Oct 11, 2013

• avoid NPE resuming from checkpoint if "stats" is {} in warcWriter checkpoint json

  nlevitt

  committed
  38a12b2

  Copy full SHA for 38a12b2

• HER-2056 new option startNewFilesOnCheckpoint on writers, true by default for backward compatibility

  nlevitt

  committed
  a1f84d3

  Copy full SHA for a1f84d3

Commits on Sep 12, 2013

• Merge branch 'master' of github.com:internetarchive/heritrix3

  nlevitt

  committed
  7ad90b3

  Copy full SHA for 7ad90b3

Commits on Sep 10, 2013

• use libs version ${project.version}

  nlevitt

  committed
  57311db

  Copy full SHA for 57311db

Commits on Sep 8, 2013

• tweak io block size in FileUtils.appendTo(), referencing performance metrics documented in gnu coreutils (used e.g. for /bin/cat)

  nlevitt

  committed
  140ba3e

  Copy full SHA for 140ba3e

• commented-out default for new setting forgetAllButLatest on CheckpointService

  nlevitt

  committed
  254811f

  Copy full SHA for 254811f

• avoid infinite loop spitting out stack traces on BeansException on startup

  nlevitt

  committed
  f096609

  Copy full SHA for f096609

• avoid deadlock in case of BeansException at crawl startup

  nlevitt

  committed
  a00141e

  Copy full SHA for a00141e

• include urlsWritten in checkpoint, and be backward compatible with old checkpoints

  nlevitt

  committed
  071cbe9

  Copy full SHA for 071cbe9

• custom kryo serialization for Inet4Address in CrawlHost since default doesn't work right, and junit test

  nlevitt

  committed
  c49b465

  Copy full SHA for c49b465

Pagination

Previous

Next