Skip to content

v1.1.2: AI-Powered Extract Function and LinkedIn Sync Improvements

Choose a tag to compare

View all tags
@Idanvilenski Idanvilenski released this 04 Sep 14:53
· 88 commits to main since this release
v1.1.2
b4aec7e

New Features

  • AI-Powered Extract Function: New extract() function that combines web scraping with OpenAI's language models to extract targeted information from web pages using natural language queries
  • LinkedIn Sync Mode Fix: Fixed LinkedIn scraping sync mode to use the correct API endpoint and request structure for immediate data retrieval

Improvements

  • Set sync=True as default for all LinkedIn scraping methods for better user experience
  • Improved unit test coverage
  • Enhanced error handling for LinkedIn API responses

Examples

  • Added extract_example.py demonstrating AI-powered content extraction capabilities
  • Updated LinkedIn examples to showcase sync functionality

Technical Changes

  • Use correct /scrape endpoint for synchronous LinkedIn requests
  • Pass dataset_id as URL parameter with proper flags
  • Handle both 200 and 202 status codes appropriately
  • Maintain backward compatibility for async operations
Assets 2
Loading