Commits · main · ScraperX / scraperx

Feb 04, 2024
- formatting · 54097d8d
  Eddy Hintze authored 1 year ago
  
  View commits for tag 0.7.1 0.7.1
  
  54097d8d
- Added ignore_missing_null_keys to testing · 55ddec75
  Eddy Hintze authored 1 year ago
  
  55ddec75
Sep 25, 2023
- Merge branch 'post_extract_update' into 'main' · c218482b
  Eddy Hintze authored 1 year ago
  
  Allow extract_task to return a list See merge request !7
  View commits for tag 0.7.0 0.7.0
  
  c218482b
- Allow extract_task to return a list · dd93cbf2
  Eddy Hintze authored 1 year ago
  
  dd93cbf2
Mar 29, 2023
- Merge branch 'debug' into 'main' · 45bdbaea
  Eddy Hintze authored 2 years ago
  
  Fixes around test validation. Replaced cchardet See merge request !6
  View commits for tag 0.6.0 0.6.0
  
  45bdbaea
- updated ci for publishing package · 179cac7e
  Eddy Hintze authored 2 years ago
  
  179cac7e
- Fixed imports · 85451e63
  Eddy Hintze authored 2 years ago
  
  85451e63
Mar 28, 2023
- Set file encoding to utf-8 · 77053e38
  Eddy Hintze authored 2 years ago
  
  77053e38
- Renable encoding checking · f0eeba19
  Eddy Hintze authored 2 years ago
  
  f0eeba19
- Merge branch 'sid-deshmukh-main' into debug · 991acf62
  Eddy Hintze authored 2 years ago
  
  991acf62
- Merge branch 'main' of https://github.com/sid-deshmukh/scraperx into sid-deshmukh-main · cc343c76
  Eddy Hintze authored 2 years ago
  
  cc343c76
Mar 27, 2023
- Replaced cchardet with charset_normalizer · 41b99213
  Eddy Hintze authored 2 years ago
  
  41b99213
Feb 13, 2023
- Merge pull request #1 from sid-deshmukh/Testfix · a10dab11
  sid-deshmukh authored 2 years ago
  
  Added condition to convert Ordered set to list
  a10dab11
- Added condition to convert Ordered set to list · d21f04cd
  sdeshmuk authored 2 years ago
  
  d21f04cd
Mar 02, 2022
- flake8 fix · ba834637
  Eddy Hintze authored 3 years ago
  
  ba834637
- Removed file not found error for config yaml, errors will happen when validating if needed · f101012f
  Eddy Hintze authored 3 years ago
  
  f101012f
- Revert "re-enable cchardet encoding detection" · cce88e4a
  Eddy Hintze authored 3 years ago
  
  This reverts commit fcfb0eac.
  cce88e4a
- added client_kwargs to s3 upload · 362f0653
  Eddy Hintze authored 3 years ago
  
  362f0653
- re-enable cchardet encoding detection · fcfb0eac
  Eddy Hintze authored 3 years ago
  
  fcfb0eac
- Updated smart_open s3 arguments · 0290c943
  Eddy Hintze authored 3 years ago
  
  0290c943
Dec 08, 2021
- Force use utf-8 encodings · 822d4dc0
  Eddy Hintze authored 3 years ago
  
  822d4dc0
- Allow re-generating tests inside the tests folder · f823446d
  Eddy Hintze authored 3 years ago
  
  f823446d
Nov 17, 2021
- Better proxy debugging · cc6e78cb
  Eddy Hintze authored 3 years ago
  
  cc6e78cb
- Add proxy debug string · 9b6e1fd5
  Eddy Hintze authored 3 years ago
  
  9b6e1fd5
Aug 11, 2021
- Version bump, fixed json issue in tests · 86b2bc54
  Eddy Hintze authored 3 years ago
  
  View commits for tag 0.5.11 0.5.11
  
  86b2bc54
Jul 13, 2021
- Support for multiple scrapers in a single file · 20eae944
  Eddy Hintze authored 3 years ago
  
  View commits for tag 0.5.10 0.5.10
  
  20eae944
Apr 05, 2021
- Fixed bug when running unittests for a scraper · e759ebb9
  Eddy Hintze authored 4 years ago
  
  View commits for tag 0.5.9 0.5.9
  
  e759ebb9
Mar 25, 2021
- Fixed reading the file encoding when running create-test · 25299a8d
  Eddy Hintze authored 4 years ago
  
  View commits for tag 0.5.8 0.5.8
  
  25299a8d
Mar 22, 2021
- version bump to 0.5.7 · 770398df
  Eddy Hintze authored 4 years ago
  
  View commits for tag 0.5.7 0.5.7
  
  770398df
- Added tests for rate_limited util · fe87eb0d
  Eddy Hintze authored 4 years ago
  
  fe87eb0d
- Merge branch 'file_encoding' into 'stagging' · 0e5f265f
  Eddy Hintze authored 4 years ago
  
  File encoding See merge request !5
  0e5f265f
Mar 19, 2021
- Gitignore was ignoring the test files · a60a4bda
  Eddy Hintze authored 4 years ago
  
  a60a4bda
- tox fixes · a33002ce
  Eddy Hintze authored 4 years ago
  
  a33002ce
- tox fixes · de4bd4a5
  Eddy Hintze authored 4 years ago
  
  de4bd4a5
- Fixed getting encoding from s3 file. Added tests around encoding local & s3 files · 6a3a3aa1
  Eddy Hintze authored 4 years ago
  
  6a3a3aa1
- Ignore .pyc files · 0bcc5f77
  Eddy Hintze authored 4 years ago
  
  0bcc5f77
Mar 05, 2021
- Release package to gitlab server too · 0fc4a2d7
  Eddy Hintze authored 4 years ago
  
  0fc4a2d7
- Auto tag releases · 9084de2a
  Eddy Hintze authored 4 years ago
  
  View commits for tag 0.5.6 0.5.6
  
  9084de2a
Feb 16, 2021
- Fixed encoding issues. Version 0.5.6 · dee071a8
  Eddy Hintze authored 4 years ago
  
  dee071a8
Feb 12, 2021
- Use chardet to guess files encoding · 38accb99
  Eddy Hintze authored 4 years ago
  
  38accb99