Skip to content

Commit bb94d1f

Browse files
committed
Adding a schedule library + Update the README, add some function for presentation of PYTOME and the Job
1 parent 96edc6b commit bb94d1f

File tree

3 files changed

+105
-55
lines changed

3 files changed

+105
-55
lines changed

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,10 @@ PyToMe have a list of website where it wil fetch data(jobs/projects) and will no
2323
# Launch it
2424
cd api/ && python app.py
2525
```
26+
## Dependencies
27+
* requests
28+
* BeautifulSoup
29+
* schedule
2630

2731
## TODO
2832
- [ In progress... ] The Python Job (Collecting/Fetching jobs all over website with frequency.)

api/app.py

Lines changed: 99 additions & 54 deletions
Original file line numberDiff line numberDiff line change
@@ -3,61 +3,106 @@
33
# Author: [Sanix-darker](https://github.com/sanix-darker)
44
#
55
# Ressources / WebSites used to fetch data:
6-
# https://github.com/pyjobs/annonces
7-
# https://djangogigs.com/gigs/remote/
8-
# https://angel.co/europe/python/jobs
9-
# https://remoteml.com/tags/Python/
10-
# https://nodesk.co/remote-jobs/python/
11-
# https://www.codementor.io/freelance-jobs/python
12-
# https://www.indeed.com.ph/Remote-Python-jobs
13-
# https://remote4me.com/remote-python-jobs
14-
# https://www.irishjobs.ie/Remote-Python-Jobs
15-
# https://www.reed.co.uk/jobs/python-developer-remote/36144618
16-
# https://www.simplyhired.com/search?q=remote+python+developer&l=austin%2C+tx&job=ViO7geREaxO513t_xvNXtyVy2t9_kmX9_BjPGMevSnLgkOwH73PMww
17-
# https://remotees.com/remote-python-jobs
18-
# https://www.indeed.co.uk/Python-jobs-in-Remote
19-
# https://jobs.trovit.co.uk/remote-python-jobs
20-
# https://www.glassdoor.co.uk/Job/uk-remote-python-jobs-SRCH_IL.0,2_IN2_KO3,16.htm
21-
# https://www.cybercoders.com/jobs/remote-python-developer-jobs/
22-
# https://www.pearsonfrank.com/32655/uk-remote-python-developer
23-
# https://www.flexjobs.com/jobs/python
24-
# https://twitter.com/remotepython?lang=en
25-
# https://www.reddit.com/r/remotepython/
26-
# https://www.remotelyawesomejobs.com/remote-python-jobs/
27-
# https://europeremotely.com/remote-jobs/Python
28-
# https://www.glassdoor.com/Job/remote-python-jobs-SRCH_IL.0,6_IS11047_KO7,13.htm
29-
# https://www.glassdoor.com/Job/remote-python-jobs-SRCH_KO0,13.htm
30-
# https://www.linkedin.com/jobs/python-remote-jobs
31-
# https://stackoverflow.com/jobs/remote-developer-jobs-using-python
32-
# https://weworkremotely.com/remote-jobs/search?utf8=%E2%9C%93&term=python
33-
# https://www.workingnomads.co/remote-python-jobs
34-
# https://www.python.org/jobs/location/telecommute/
35-
# https://jobs.github.com/positions?description=python
36-
# https://pythonjobs.github.io/
37-
# https://www.python.org/jobs/
38-
# https://www.indeed.com/q-Remote-Python-Developer-jobs.html
39-
# https://www.indeed.com/q-Remote-Python-jobs.html
40-
# https://www.indeed.com/q-Python-jobs.html
41-
# https://www.indeed.com/q-Python-Developer-jobs.html
42-
# https://remoteok.io/remote-python-jobs
43-
# https://www.linkedin.com/jobs/python-jobs
44-
# https://www.linkedin.com/jobs/python-developer-jobs
45-
# https://www.remotepython.com/
46-
# https://www.pythonjobs.com/
47-
# https://www.glassdoor.com/Job/python-developer-jobs-SRCH_KO0,16.htm
48-
# https://www.naukri.com/python-developer-jobs
49-
# https://www.upwork.com/o/jobs/browse/skill/python/
50-
# https://www.seek.co.nz/python-jobs
51-
# https://www.nijobs.com/Python-Jobs-in-Belfast
52-
# https://www.irishjobs.ie/Python-Developer-Jobs-in-Dublin
53-
# https://stackoverflow.com/jobs/developer-jobs-using-python
54-
# https://www.technojobs.co.uk/python-jobs
55-
# https://www.pythonjobshq.com/
6+
# https://github.com/pyjobs/annonces~
7+
# https://djangogigs.com/gigs/remote/~
8+
# https://angel.co/europe/python/jobs~
9+
# https://remoteml.com/tags/Python/~
10+
# https://nodesk.co/remote-jobs/python/~
11+
# https://www.codementor.io/freelance-jobs/python~
12+
# https://www.indeed.com.ph/Remote-Python-jobs~
13+
# https://remote4me.com/remote-python-jobs~
14+
# https://www.irishjobs.ie/Remote-Python-Jobs~
15+
# https://www.reed.co.uk/jobs/python-developer-remote/36144618~
16+
# https://www.simplyhired.com/search?q=remote+python+developer&l=austin%2C+tx&job=ViO7geREaxO513t_xvNXtyVy2t9_kmX9_BjPGMevSnLgkOwH73PMww~
17+
# https://remotees.com/remote-python-jobs~
18+
# https://www.indeed.co.uk/Python-jobs-in-Remote~
19+
# https://jobs.trovit.co.uk/remote-python-jobs~
20+
# https://www.glassdoor.co.uk/Job/uk-remote-python-jobs-SRCH_IL.0,2_IN2_KO3,16.htm~
21+
# https://www.cybercoders.com/jobs/remote-python-developer-jobs/~
22+
# https://www.pearsonfrank.com/32655/uk-remote-python-developer~
23+
# https://www.flexjobs.com/jobs/python~
24+
# https://twitter.com/remotepython?lang=en~
25+
# https://www.reddit.com/r/remotepython/~
26+
# https://www.remotelyawesomejobs.com/remote-python-jobs/~
27+
# https://europeremotely.com/remote-jobs/Python~
28+
# https://www.glassdoor.com/Job/remote-python-jobs-SRCH_IL.0,6_IS11047_KO7,13.htm~
29+
# https://www.glassdoor.com/Job/remote-python-jobs-SRCH_KO0,13.htm~
30+
# https://www.linkedin.com/jobs/python-remote-jobs~
31+
# https://stackoverflow.com/jobs/remote-developer-jobs-using-python~
32+
# https://weworkremotely.com/remote-jobs/search?utf8=%E2%9C%93&term=python~
33+
# https://www.workingnomads.co/remote-python-jobs~
34+
# https://www.python.org/jobs/location/telecommute/~
35+
# https://jobs.github.com/positions?description=python~
36+
# https://pythonjobs.github.io/~
37+
# https://www.python.org/jobs/~
38+
# https://www.indeed.com/q-Remote-Python-Developer-jobs.html~
39+
# https://www.indeed.com/q-Remote-Python-jobs.html~
40+
# https://www.indeed.com/q-Python-jobs.html~
41+
# https://www.indeed.com/q-Python-Developer-jobs.html~
42+
# https://remoteok.io/remote-python-jobs~
43+
# https://www.linkedin.com/jobs/python-jobs~
44+
# https://www.linkedin.com/jobs/python-developer-jobs~
45+
# https://www.remotepython.com/~
46+
# https://www.pythonjobs.com/~
47+
# https://www.glassdoor.com/Job/python-developer-jobs-SRCH_KO0,16.htm~
48+
# https://www.naukri.com/python-developer-jobs~
49+
# https://www.upwork.com/o/jobs/browse/skill/python/~
50+
# https://www.seek.co.nz/python-jobs~
51+
# https://www.nijobs.com/Python-Jobs-in-Belfast~
52+
# https://www.irishjobs.ie/Python-Developer-Jobs-in-Dublin~
53+
# https://stackoverflow.com/jobs/developer-jobs-using-python~
54+
# https://www.technojobs.co.uk/python-jobs~
55+
# https://www.pythonjobshq.com/~
5656

5757
import requests
58-
from bs4 import BeautifulSoup
58+
import BeautifulSoup
59+
import schedule
60+
import time
5961

62+
# Globlas variables
63+
WEBSITE_DATABASE = "website.pytome"
6064

61-
def fetch_fromIT(url, schema):
62-
soup = BeautifulSoup('\n'.join(requests.get(url).text.splitlines()[1:10]), 'html.parser')
63-
return [i.get('href') for i in soup.find_all(schema)]
65+
def Presentation():
66+
print "-------------------------------------------------------"
67+
print "--------------------- PYTHOME v0.1 --------------------"
68+
print "-------------------------------------------------------"
69+
print "====================================By S@n1x-d4rk3r===="
70+
71+
# This method take as parameter:
72+
# -the url,
73+
# -the example of schema to fetch and
74+
# -the total of result to be get
75+
def fetch_fromIT(url, schema, total):
76+
soup = BeautifulSoup('\n'.join(requests.get(url).text.splitlines()[1:total]), 'html.parser')
77+
return [i.get('href') for i in soup.find_all(schema)]
78+
79+
def getWebSite_and_schema_and_save_data():
80+
result = ""
81+
# Getting list of links and schemas
82+
# and remove whitespace characters like `\n` at the end of each line
83+
lines = [line.rstrip('\n') for line in open(WEBSITE_DATABASE)]
84+
# Loop in lines, fetch and get result
85+
for x in lines:
86+
result += fetch_fromIT(x.plit('~')[0], x.plit('~')[1], 15)
87+
return result;
88+
89+
# The method JOB
90+
def PYTOME_job():
91+
print "Starting the Job............."
92+
getWebSite_and_schema_and_save_data()
93+
94+
# Other Schedules Options
95+
# schedule.every(5).to(10).minutes.do(job)
96+
# schedule.every().monday.do(job)
97+
# schedule.every().wednesday.at("13:15").do(job)
98+
# schedule.every(10).minutes.do(job)
99+
# schedule.every().hour.do(job)
100+
# Let say, automation every day at 00:01
101+
#schedule.every().day.at("00:01").do(PYTOME_job)
102+
103+
104+
Presentation()
105+
PYTOME_job()
106+
# while True:
107+
# schedule.run_pending()
108+
# time.sleep(1)

api/requirements.txt

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,3 @@
11
requests==2.13.0
2-
BeautifulSoup
2+
BeautifulSoup
3+
schedule

0 commit comments

Comments
 (0)