Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 1, 2013

• Upgrade versions, remove unnecessary dependencies, and issue new release

  

  Jason Bennett

  committedNov 1, 2013
  977648c

• Remove idle connection monitor - clojure AOT hangs when the thread is thrown during compile time

  

  Jason Bennett

  committedNov 1, 2013
  bec521a

• Fix versions for deployment

  

  Jason Bennett

  committedNov 1, 2013
  bcf6dcb

Commits on Oct 31, 2013

• Merge branch 'master' of https://github.com/skyshard/goose

  

  Jason Bennett

  committedOct 31, 2013
  00087ec

Commits on Jul 31, 2013

• ignore huffingtonpost related slideshow

  skyshard

  committedJul 31, 2013
  a505e33

Commits on Jul 26, 2013

• ignore javascript links

  skyshard

  committedJul 26, 2013
  ed41e37

• shorter connection timeout for images

  skyshard

  committedJul 26, 2013
  5fc462d

Commits on Jul 25, 2013

• fix other canonical link types to get the abs href, set the base uri when parsing

  skyshard

  committedJul 25, 2013
  ff8613f

• fix canonical urls to get the absolute href

  skyshard

  committedJul 25, 2013
  070d528

• remove paragraphs that are completely links as well

  skyshard

  committedJul 25, 2013
  c7a22da

• don't keep alive forever if value isn't specified, just leave the connection open for 10 seconds

  skyshard

  committedJul 25, 2013
  a5c9d28

• don't crash on documents without body (eg. a page with just frame set?) doesn't actually do extraction in this case...

  skyshard

  committedJul 25, 2013
  435ab83

Commits on Jul 23, 2013

• changed link extraction to give url -> text map

  skyshard

  committedJul 23, 2013
  bc163be

Commits on Jul 20, 2013

• throw more errors (couldn't get it to throw parsing errors or content not found properly inside the for() for crawler… leaving for later)

  skyshard

  committedJul 20, 2013
  2567920

Commits on Jul 19, 2013

• don't drop all lists in content immediately, score them first (and check if they look like lists of links)

  skyshard

  committedJul 19, 2013
  91cbc82

Commits on Jul 18, 2013

• ignore # href

  skyshard

  committedJul 18, 2013
  407893a

• remove junit dep

  skyshard

  committedJul 18, 2013
  802551d

• guess date from url if the extractor fails, logic from snacktory: https://github.com/karussell/snacktory/blob/master/src/main/java/de/jetwick/snacktory/SHelper.java

  skyshard

  committedJul 18, 2013
  39d9032

• better description, canonical link extractors

  skyshard

  committedJul 18, 2013
  6b9814a

• stricter non-removal of .scrollable class

  skyshard

  committedJul 18, 2013
  0849a97

• add document in trace for easier debug

  skyshard

  committedJul 18, 2013
  6cd9fc2

• referer and cookie support for html fetching

  skyshard

  committedJul 18, 2013
  aa514fd

• stricter small paragraph removal… monitor how well this does

  skyshard

  committedJul 18, 2013
  4b91e2f

• link extraction from content node

  skyshard

  committedJul 18, 2013
  f4882a6

• getting tests running (and failing)

  skyshard

  committedJul 18, 2013
  b9d7a20

Commits on Jul 17, 2013

• fixing gizmodo, mashable

  skyshard

  committedJul 17, 2013
  15e4921

• handling gzipped responses, content type detection failure

  skyshard

  committedJul 17, 2013
  40f3a9e

• Revert "Added the Acceso Maven repository. Using the Lingpipe language identifier." 15875dc

  skyshard

  committedJul 17, 2013
  cc22a49

• Merge https://github.com/chechu/goose into chechu

  skyshard

  committedJul 17, 2013
  950ebcb

Commits on Jun 25, 2013

• Commit version 2.1.23

  

  Jason Bennett

  committedJun 25, 2013
  4992f86

Commits on May 30, 2013

• Change repository location

  

  Jason Bennett

  committedMay 30, 2013
  047f2aa

Commits on May 18, 2013

• Revert "remove root build.sbt to try to get project compile to work"

  skyshard

  committedMay 18, 2013
  1bb28e9

• remove root build.sbt to try to get project compile to work

  skyshard

  committedMay 18, 2013
  7636f6b

• less logging

  skyshard

  committedMay 18, 2013
  40b80b9

• attempt fixes for blank content timeouts

  skyshard

  committedMay 18, 2013
  042a3b0

Pagination

PreviousNext