職務名稱：Data Engineer
職缺需求：
- Solid Python knowledge
- 1+ years experience running large scale web scrapes
- 1+ years experience with applications designed to display archived web content
- Familiarity with techniques and tools for crawling, extracting, and processing data (Scrapy, Pandas, Mapreduce, SQL, BeautifulSoup, etc.)
- Familiarity with Linux/UNIX, HTTP, HTML, Javascript, and Networking
工作地點：
不限工作地點，可在家或共同工作空間辦公。
薪資福利：
- Competitive Salary and equity package.
- Health, Dental, and Vision Insurance.
- 401k Retirement package.
- Unlimited PTO package.
- A shorter commute to our awesome office in Downtown Oakland.
申請方式：
直接透過網站申請
官網：https://reurl.cc/nz5xG2
The Role:
We are looking for a web-scraping focused Data Engineer. The candidate will be responsible for extracting and ingesting data from websites using web crawling tools. The candidate will own the creation process of these tools and workflows to scrape web content and manage data. The team will rely on the candidate to test the data and the scraper to ensure accuracy and quality. They will also identify and rectify any issues with breaks as well as scale scrapers as needed.
