Browse

Data Extraction .cursorrules strategies

Filters

Tech

Clear

React

Tailwind CSS

Node.js

Tailwind

JavaScript

Shadcn UI

Next.js

Radix UI

Python

WebP

Zod

JSX

Vite

CSS

Supabase

HTML

Jest

Next.js App Router

PostgreSQL

Docker

Redis

Pydantic

Tailwind Aria

TailwindCSS

FastAPI

Git

ESLint

pytest

react-hook-form

Solidity

Vercel

JSDoc

GitHub Actions

Typescript

Prettier

Suspense

Vitest

ARIA

Zustand

React Testing Library

Celery

Radix

Shadcn

SQLAlchemy

PHP

SvelteKit

JSON

Vue.js

Pinia

MongoDB

tRPC

Clerk

Expo

PEP 8

SSR

Prisma

dotenv

GitLab CI

SQLite

SQL

Playwright

tanStackQuery

DaisyUI

Laravel

RESTful API

Drizzle ORM

VueUse

Express

asyncpg

TypeScript

scikit-learn

pandas

GitHub

RabbitMQ

Rust

Java

GraphQL

Svelte

Elixir

ES6

Nuxt 3

styled-components

Vue Router

Astro

Svelte 5

Markdown

OpenZeppelin

Drizzle

Stripe

Flexbox

CORS

Lighthouse

JWT

Swagger

aiomysql

Ruff

Langchain

Django

matplotlib

Clear

Web Development

Frontend Development

Code Style

Programming

Naming Conventions

Testing

State Management

Backend Development

Code Optimization

Software Engineering

Accessibility

Programming Best Practices

Responsive Design

Code Structure

Version Control

Database Management

UI Design

API Development

Code Quality

TypeScript Best Practices

Authentication

TypeScript

Security

Syntax and Formatting

JavaScript

Best Practices

Data Fetching

Internationalization

Coding Best Practices

React

performance optimization

Performance Optimization

Software Development

Coding Standards

API Integration

Object-Oriented Programming

Code Review

Testing and Debugging

Image Optimization

SEO

Game Development

Code Readability

Deployment

Clean Code

User Interface

JavaScript Frameworks

UI Components

UI and Styling

Declarative Programming

Code Modularity

Security Best Practices

Web Application Development

Error Handling

UI Development

JavaScript Libraries

Design Patterns

TypeScript Guidelines

Server-Side Rendering

TypeScript Usage

Programming Guidelines

Modularization

Code Documentation

error handling

functional programming

Coding Style

Scalability

Form Validation

SEO Optimization

Smart Contracts

Dependency Injection

Test-Driven Development

Static Site Generation

Routing

File Organization

Code Organization

Coding Guidelines

Testing and Quality Assurance

Technical Writing

API Design

Node.js

Full Stack Development

Python development

CI/CD

UI/UX design

Functional Programming

Documentation

Python

Validation

Performance

Code Formatting

Python programming

Code Maintainability

Build and Deployment

Decentralized Applications

Artificial Intelligence

Project Management

Web Vitals

Server Components

Blockchain

Coding Practices

Show

5

rules

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.

NEW

CSS Custom Cursor .cursorrules prompt file

Python Web Scraping:

Key Principles:
- Write concise, modular scraping functions with accurate examples using Python and libraries like requests and BeautifulSoup.
- Prefer iteration and modularization to avoid duplication.
- Use descriptive variable names that indicate intent (e.g., is_valid_url, has_next_page).
- Organize scripts with lowercase and underscores for filenames (e.g., scrapers/my_scraper.py).
- Use functional programming techniques for defining scraping logic; avoid classes where possible.

Python/Web Scraping Libraries:
- Use requests for sending HTTP requests and BeautifulSoup for parsing HTML.
- Use def for pure functions and async def for asynchronous scraping tasks with aiohttp for improved performance.
- Use type hints for all function signatures to ensure clarity.
- Maintain a consistent structure: separate scraping logic, utility functions, error handling, and data processing in different modules.

Error Handling and Edge Cases:
- Handle invalid URLs, timeouts, and unexpected HTML structures at the beginning of functions.
- Use early returns for handling errors (e.g., invalid responses or missing HTML elements) to avoid deeply nested conditions.
- Reserve the main parsing logic for the "happy path" to improve readability.
- Avoid unnecessary else blocks—use the if-return pattern for cleaner flow control.
- Implement error logging with logging to capture failed requests or parsing issues.
- Use retries with backoff mechanisms (e.g., tenacity) for handling transient network issues or rate-limiting responses.

Dependencies:
- requests, BeautifulSoup4, and optionally lxml for HTML parsing.
- aiohttp for asynchronous scraping when dealing with large volumes of data.
- logging for detailed error logging and monitoring.

Scraping-Specific Guidelines:
- Use functions for individual tasks: sending requests, parsing HTML, handling pagination, and saving data.
- Prefer asynchronous scraping for I/O-bound tasks like making multiple requests to external servers.
- Rely on tools like lxml for faster HTML parsing and aiohttp for high concurrency in asynchronous scraping.
- Minimize inline parsing logic—use utility functions to handle common tasks like extracting links, text, or images.

Performance Optimization:
- Minimize blocking I/O by using asynchronous libraries for web scraping (e.g., aiohttp).
- Implement caching strategies for avoiding redundant requests and speeding up repeat operations.
- Use efficient data parsing and extraction with libraries like lxml for larger datasets.
- Apply lazy loading techniques to avoid unnecessary data fetching.
- Handle rate limits and request throttling by respecting robots.txt files and introducing delays between requests.

Key Conventions:
- Use modular functions and adhere to single-responsibility principles in scraping logic.
- Ensure scalability by using non-blocking, asynchronous flows for high-concurrency scraping tasks.
- Structure scripts for readability, maintainability, and performance, with clear separation of concerns.
- Refer to the documentation of requests, BeautifulSoup, aiohttp, and lxml for best practices on HTTP requests, HTML parsing, and efficient scraping.sss

stack: