Skip to content

Commit 5b682e3

Browse files
committed
Scraper: fixes #4 (http header fix)
1 parent df49c23 commit 5b682e3

File tree

3 files changed

+150
-119
lines changed

3 files changed

+150
-119
lines changed

go.mod

Lines changed: 26 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,33 @@
11
module github.com/daehee/mildew
22

3-
go 1.15
3+
go 1.23.0
4+
5+
toolchain go1.24.1
46

57
require (
6-
github.com/antchfx/xmlquery v1.3.0 // indirect
78
github.com/caffix/stringset v0.0.0-20201218054545-37e95a70826c
8-
github.com/gocolly/colly/v2 v2.1.1-0.20201130153714-389278068768
9+
github.com/gocolly/colly/v2 v2.2.0
910
github.com/stretchr/testify v1.3.0
10-
golang.org/x/net v0.0.0-20200822124328-c89045814202 // indirect
11-
golang.org/x/text v0.3.3 // indirect
12-
google.golang.org/protobuf v1.25.0 // indirect
11+
)
12+
13+
require (
14+
github.com/PuerkitoBio/goquery v1.10.2 // indirect
15+
github.com/andybalholm/cascadia v1.3.3 // indirect
16+
github.com/antchfx/htmlquery v1.3.4 // indirect
17+
github.com/antchfx/xmlquery v1.4.4 // indirect
18+
github.com/antchfx/xpath v1.3.3 // indirect
19+
github.com/bits-and-blooms/bitset v1.22.0 // indirect
20+
github.com/davecgh/go-spew v1.1.1 // indirect
21+
github.com/gobwas/glob v0.2.3 // indirect
22+
github.com/golang/groupcache v0.0.0-20241129210726-2c02b8208cf8 // indirect
23+
github.com/golang/protobuf v1.5.4 // indirect
24+
github.com/kennygrant/sanitize v1.2.4 // indirect
25+
github.com/nlnwa/whatwg-url v0.6.1 // indirect
26+
github.com/pmezard/go-difflib v1.0.0 // indirect
27+
github.com/saintfish/chardet v0.0.0-20230101081208-5e3ef4b5456d // indirect
28+
github.com/temoto/robotstxt v1.1.2 // indirect
29+
golang.org/x/net v0.37.0 // indirect
30+
golang.org/x/text v0.23.0 // indirect
31+
google.golang.org/appengine v1.6.8 // indirect
32+
google.golang.org/protobuf v1.36.6 // indirect
1333
)

0 commit comments

Comments
 (0)