Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 21, 2014

• Merge pull request internetarchive#112 from nlevitt/amqp-receiver-deadlock

  Show description for 2c9e82a
  

  vonrosen

  committed
  2c9e82a

  Copy full SHA for 2c9e82a

Commits on Nov 14, 2014

• Merge pull request internetarchive#108 from nlevitt/aitfive-203

  Show description for 3609abe
  

  vonrosen

  committed
  3609abe

  Copy full SHA for 3609abe

Commits on Nov 12, 2014

• Merge pull request internetarchive#103 from adam-miller/SeedsReportRedirectFix

  Show description for 54555e8
  nlevitt

  committed
  54555e8

  Copy full SHA for 54555e8

• Merge pull request internetarchive#110 from kris-sigur/httpclient-4.3.6

  Show description for 40bc02c
  nlevitt

  committed
  40bc02c

  Copy full SHA for 40bc02c

Commits on Nov 11, 2014

• Upgrade to httpclient 4.3.6

  kris-sigur

  committed
  0212a55

  Copy full SHA for 0212a55

• make sure the kafka producer thread is not in the ToePool thread group, to stop it from being interrupted at the end of the crawl

  nlevitt

  committed
  7be1fc6

  Copy full SHA for 7be1fc6

• Revert "Revert "switch to org.apache.kafka.clients.producer.KafkaProducer to see if we can avoid the InterruptedException at the end of the crawl (and log warnings on failure to send message)""

  Show description for 743ab3c
  nlevitt

  committed
  743ab3c

  Copy full SHA for 743ab3c

Commits on Nov 10, 2014

• Revert "switch to org.apache.kafka.clients.producer.KafkaProducer to see if we can avoid the InterruptedException at the end of the crawl (and log warnings on failure to send message)"

  Show description for a0f70d0
  nlevitt

  committed
  a0f70d0

  Copy full SHA for a0f70d0

Commits on Nov 8, 2014

• Merge pull request internetarchive#100 from vonrosen/ari-4061

  Show description for d96b1f8
  nlevitt

  committed
  d96b1f8

  Copy full SHA for d96b1f8

Commits on Nov 7, 2014

• Merge branch 'aitfive-203' of github.com:nlevitt/heritrix3 into aitfive-203

  nlevitt

  committed
  fa0a28f

  Copy full SHA for fa0a28f

• for kafka/amqp crawl log feeds, remove now redundant contentSize from extraInfo

  nlevitt

  committed
  192b3f9

  Copy full SHA for 192b3f9

• Merge branch 'extra-info-size' into aitfive-203

  nlevitt

  committed
  4527d5a

  Copy full SHA for 4527d5a

• so that it can appear in the crawl log, add contentSize to CrawlURI extraInfo, for http transactions (the only case in heritrix currently where contentLength and contentSize differ)

  nlevitt

  committed
  7312ad5

  Copy full SHA for 7312ad5

• new style kafka configuration properties

  nlevitt

  committed
  e2be3bb

  Copy full SHA for e2be3bb

• only release the lock if we actually own it (avoid java.lang.IllegalMonitorStateException at java.util.concurrent.locks.ReentrantLock.tryRelease(ReentrantLock.java:155))

  nlevitt

  committed
  82bef2a

  Copy full SHA for 82bef2a

• logging improvement

  nlevitt

  committed
  a37b879

  Copy full SHA for a37b879

• switch to org.apache.kafka.clients.producer.KafkaProducer to see if we can avoid the InterruptedException at the end of the crawl (and log warnings on failure to send message)

  nlevitt

  committed
  d2f70e5

  Copy full SHA for d2f70e5

Commits on Nov 5, 2014

• fix log messages to say "kafka"

  nlevitt

  committed
  23fa29d

  Copy full SHA for 23fa29d

• AITFIVE-203 kafka crawl log feed

  nlevitt

  committed
  77e2a47

  Copy full SHA for 77e2a47

Commits on Nov 4, 2014

• Merge pull request internetarchive#107 from vonrosen/ari-4102

  Show description for 4d0eff2
  nlevitt

  committed
  4d0eff2

  Copy full SHA for 4d0eff2

• Handle case where form does not have an action defined.

  

  Hunter Stern

  committed
  9a41b31

  Copy full SHA for 9a41b31

Commits on Nov 3, 2014

• Merge pull request internetarchive#102 from nlevitt/amqp-receiver-deadlock

  Show description for f5cf30e
  

  vonrosen

  committed
  f5cf30e

  Copy full SHA for f5cf30e

Commits on Oct 28, 2014

• use "fair" ReentrantLock -- I stepped through heritrix that appeared to be deadlocked, found that the thread trying to shut down was being starved of the lock by another thread (the StarterRestarte…

  Show description for 716e0cc
  nlevitt

  committed
  716e0cc

  Copy full SHA for 716e0cc

Commits on Oct 27, 2014

• Merge pull request internetarchive#106 from nlevitt/aitfive-39

  Show description for edcc7ce
  jkafader

  committed
  edcc7ce

  Copy full SHA for edcc7ce

• seriously, fix extraInfo handling in AMQPCrawlLogFeed

  nlevitt

  committed
  6f21ede

  Copy full SHA for 6f21ede

• Merge pull request internetarchive#105 from nlevitt/aitfive-39

  Show description for 23a07d5
  jkafader

  committed
  23a07d5

  Copy full SHA for 23a07d5

• fix extraInfo handling in AMQPCrawlLogFeed

  nlevitt

  committed
  7e4b171

  Copy full SHA for 7e4b171

• Merge pull request internetarchive#104 from nlevitt/aitfive-39

  Show description for f25c171
  jkafader

  committed
  f25c171

  Copy full SHA for f25c171

Commits on Oct 22, 2014

• change field names to match new druid config

  nlevitt

  committed
  13a9d3a

  Copy full SHA for 13a9d3a

• CandidatesProcessor.java

  Show description for fb23b40
  adam-miller

  committed
  fb23b40

  Copy full SHA for fb23b40

Commits on Oct 20, 2014

• Merge pull request internetarchive#101 from vonrosen/ari-4086

  Show description for 0712cb3
  nlevitt

  committed
  0712cb3

  Copy full SHA for 0712cb3

Commits on Oct 17, 2014

• avoid deadlock in AMQPUrlReceiver hopefully

  nlevitt

  committed
  d154cfb

  Copy full SHA for d154cfb

Commits on Oct 16, 2014

• Remove forcefetch for AMQP received urls so they don't get crawled twice.

  

  Hunter Stern

  committed
  8c318e5

  Copy full SHA for 8c318e5

• Remove unused variable.

  

  Hunter Stern

  committed
  78e9836

  Copy full SHA for 78e9836

• Merge pull request internetarchive#99 from nlevitt/aitfive-39

  Show description for 5909042
  

  vonrosen

  committed
  5909042

  Copy full SHA for 5909042

Pagination

Previous

Next