Results Spider

class scraper.spiders.results_spider.ResultsSpider(username, password, chatID, *args, **kwargs)

Take screenshot of http://report.aldel.org/student/test_marks_report.php and send it to the user via scraper.pipelines.ResultsScreenshotPipeline

Parameters:InitSpider (Spider) – Base Spider with initialization facilities
name = 'results'
allowed_domains = ['report.aldel.org']
login_page = 'http://report.aldel.org/student_page.php'
start_urls = ['http://report.aldel.org/student/test_marks_report.php']
init_request()

This function is called before crawling starts.

login(response)

Generate a login request.

check_login_response(response)

Check the response returned by a login request to see if we are successfully logged in.

parse(response)

Send a SplashRequest and forward the response to parse_result()

parse_result(response)

Downloads and saves the attendance report in files/<Student_ID>_tests.png format.

scraper.spiders.results_spider.scrape_results(username, password, chatID)

Run the spider multiple times, without hitting ReactorNotRestartable exception. Forks own process.

Parameters:
  • username (str) – student’s PID (format: XXXNameXXXX) where X - integers
  • password (str) – student’s password for student portal
  • chatID (str) – 9-Digit unique user ID