🏢 Company Overview:
Alternative Path is an innovative data-driven technology company that specializes in delivering intelligent data solutions for businesses worldwide. The company focuses on data acquisition, analytics, automation, and AI-based insights to help organizations make informed decisions and scale effectively in a competitive digital environment.
💼 Job Details:
- Employment type: Full Time
- Experience: 8 to 10 Years
- Salary: 9L to 12L Yearly
- Location: Remote
- Work timing: 9:45 AM to 6:45 PM
- Working Days: 5 Days
- Education: Any Degree
📝 Job Description:
Alternative Path is seeking a skilled Data Engineer – Web Scraping to design, develop, and maintain large-scale web data extraction systems. The ideal candidate will be responsible for collecting, cleaning, and structuring data from multiple online sources while ensuring accuracy, efficiency, and compliance with data usage guidelines. This role requires hands-on experience with Python, automation frameworks, and scalable data pipelines.
🔑 Key Responsibilities:
- Develop, deploy, and maintain web scraping tools and scripts using Python and relevant libraries (e.g., Scrapy, BeautifulSoup, Selenium, Requests)
- Design and manage efficient ETL (Extract, Transform, Load) pipelines
- Ensure the accuracy, reliability, and consistency of collected data
- Handle proxy management, CAPTCHA solving, and data access restrictions
- Optimize scraping performance to handle large data volumes
- Collaborate with data analysts and engineers to integrate scraped data into databases or analytics platforms
- Monitor, debug, and maintain data pipelines for continuous performance improvement
🛠️ Required Skills & Qualifications:
- Strong proficiency in Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup)
- Experience with API integrations and data parsing (JSON, XML, CSV)
- Familiarity with SQL / NoSQL databases such as MySQL, MongoDB, or PostgreSQL
- Understanding of data pipelines, cloud storage, and data transformation workflows
- Experience with Docker, Airflow, or other orchestration tools is a plus
- Knowledge of data privacy and ethical web scraping practices
- Excellent problem-solving, debugging, and analytical skills
- Bachelor’s degree in Computer Science, Data Engineering, or a related field
🌟 Benefits:
- Work on advanced data acquisition and AI-driven projects
- Opportunity to collaborate with a talented global team
- Access to the latest data engineering tools and technologies
- Growth-oriented and innovation-focused work culture
- Flexible work arrangements (remote/hybrid options available)
