Reference
=========

backends
--------

asyncio_backend
~~~~~~~~~~~~~~~
.. automodule:: scrawler.backends.asyncio_backend
   :members:
   :undoc-members:

multithreading_backend
~~~~~~~~~~~~~~~~~~~~~~
.. automodule:: scrawler.backends.multithreading_backend
   :members:
   :undoc-members:

utils
--------

file_io_utils
~~~~~~~~~~~~~
.. automodule:: scrawler.utils.file_io_utils
   :members:
   :undoc-members:

general_utils
~~~~~~~~~~~~~
.. automodule:: scrawler.utils.general_utils
   :members:
   :undoc-members:

validation_utils
~~~~~~~~~~~~~~~~
.. automodule:: scrawler.utils.validation_utils
   :members:
   :undoc-members:

web_utils
~~~~~~~~~
.. automodule:: scrawler.utils.web_utils
   :members:

   .. autoclass:: ParsedUrl
      :members:

attributes
----------
.. automodule:: scrawler.attributes
   :members:
   :undoc-members:

crawling
--------
.. automodule:: scrawler.crawling
   :members:
   :undoc-members:

data_extractors
---------------
.. automodule:: scrawler.data_extractors
   :members:
   :undoc-members:

   .. autoclass:: BaseExtractor
      :members:
      :undoc-members:

   .. autofunction:: supports_dynamic_parameters

scraping
--------
.. automodule:: scrawler.scraping
   :members:
   :undoc-members:

website
--------
.. automodule:: scrawler.website
   :members:
   :undoc-members: