Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

variety bug fix #142

Merged
merged 8 commits into from
Aug 20, 2021
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
lint code
  • Loading branch information
PaleNeutron committed Aug 16, 2021
commit e64d793042085c86d1e96d3d5655f95d82b6ee4b
6 changes: 3 additions & 3 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ COPY . .
RUN make assets-build


FROM python:3.9-slim as build
FROM python:3.9-slim as python-build
RUN apt-get update && apt-get install -y g++ gcc libxslt-dev make libcurl4-openssl-dev build-essential
RUN apt-get install -y libssl-dev
WORKDIR /root
Expand All @@ -26,8 +26,8 @@ RUN apt-get update && apt-get install -y libxslt-dev libssl-dev libcurl4-openssl

RUN apt-get install -y libgbm-dev gconf-service libasound2 libatk1.0-0 libc6 libcairo2 libcups2 libdbus-1-3 libexpat1 libfontconfig1 libgcc1 libgconf-2-4 libgdk-pixbuf2.0-0 libglib2.0-0 libgtk-3-0 libnspr4 libpango-1.0-0 libpangocairo-1.0-0 libstdc++6 libx11-6 libx11-xcb1 libxcb1 libxcomposite1 libxcursor1 libxdamage1 libxext6 libxfixes3 libxi6 libxrandr2 libxrender1 libxss1 libxtst6 ca-certificates fonts-liberation libappindicator1 libnss3 lsb-release xdg-utils wget

COPY --from=build /usr/local/lib/python3.9/site-packages/ /usr/local/lib/python3.9/site-packages/
COPY --from=build /root/.cache/ms-playwright /root/.cache/ms-playwright
COPY --from=python-build /usr/local/lib/python3.9/site-packages/ /usr/local/lib/python3.9/site-packages/
COPY --from=python-build /root/.cache/ms-playwright /root/.cache/ms-playwright

WORKDIR /var/www/scylla
VOLUME /var/www/scylla
Expand Down
1 change: 0 additions & 1 deletion scylla/providers/proxy_list_provider.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,6 @@ def parse(self, document: PyQuery) -> [ProxyIP]:
def urls(self) -> [str]:
ret = []
first_url = 'http://proxy-list.org/english/index.php?p=1'
# sub = first_url[0:first_url.rfind('/')] # http://proxy-list.org/english
first_page = self.w.get_html(first_url, False)
if first_page:
ret.append(first_url)
Expand Down