Using Different Versions of Python - Compatibility/Dependencies?

  • Python
  • Thread starter WWGD
  • Start date
  • #51
Paul Colby
Gold Member
1,110
250
Perhaps it's worth asking what ML SFrame'esk lib is in python 3? Sometimes names change to protect the innocent. Other times newer options have sprung up. Data mining the web is a going concern. Seems odd no python 3 options are included.

P.S. are you using pip? Have you looked at virtual environments? Both are essential IMO for python development. (not that I've done much, but I know people who have)
 
  • #53
WWGD
Science Advisor
Gold Member
2019 Award
5,316
3,092
Any suggestion on web scraping? I am kind of worried about associated legal issues. Should I stick to using APIs?
 
  • #54
Paul Colby
Gold Member
1,110
250
I lied, I only watched 1/4 of the youtube video. I really have nothing to suggest.
 
  • #55
PeterDonis
Mentor
Insights Author
2019 Award
29,638
8,906
Any suggestion on web scraping? I am kind of worried about associated legal issues.
If you're just scraping sites that are publicly visible anyway, I don't see why there would be any legal issues; everything on the page is there for the public to see. The site might throttle you if it detects that you're requesting too much data in too short a time, but that's a technical issue, not a legal issue; you just need to scrape at a slow enough rate, the same way the web crawlers for Google and other search engines do.
 

Related Threads on Using Different Versions of Python - Compatibility/Dependencies?

  • Last Post
Replies
2
Views
2K
Replies
1
Views
368
Replies
1
Views
1K
  • Last Post
Replies
8
Views
3K
Replies
2
Views
4K
Replies
9
Views
12K
Replies
21
Views
1K
Replies
2
Views
2K
Replies
2
Views
2K
  • Last Post
Replies
0
Views
2K
Top