Data pipeline status

This file shows the latest status of the data pipeline.

Vaccinations

Get (scraping)

8/112 scripts failed, 36/112 were skipped. Latest update was 2023-06-16T07:04:53.

module status timestamp execution_time (sec) error
cowidev.vax.incremental.taiwan ❌ 2023-06-16T07:04:53 6.04
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/taiwan.py", line 184, in main
    Taiwan().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/taiwan.py", line 170, in export
    data = self.read().pipe(self.pipeline)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/taiwan.py", line 38, in read
    data = self.parse_data(df, soup)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/taiwan.py", line 122, in parse_data
    "date": self._parse_date(soup),
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/taiwan.py", line 156, in _parse_date
    date_str = re.search(regex, date_raw).group(1)
AttributeError: 'NoneType' object has no attribute 'group'
cowidev.vax.incremental.paho ❌ 2023-06-16T07:04:47 82.29
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 195, in main
    PAHO().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 190, in export
    df = self.read().pipe(self.pipeline)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 167, in pipeline
    df.pipe(self.pipe_check_columns)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 122, in pipe_check_columns
    raise ValueError(f"Missing column fields: {columns_missing}. Present columns are: {df.columns}")
ValueError: Missing column fields: {'Country code', '2nd additional dose', 'Single dose', '1st additional dose', 'Total doses', 'Country/ Territory', 'Second dose', 'First dose'}. Present columns are: Index(['date,location,total_vaccinations,people_vaccinated,people_fully_vaccinated,total_boosters,new_vaccinations,new_vaccinations_interpolated,new_people_vaccinated_interpolated,new_vaccinations_smoothed,new_people_vaccinated_smoothed', 'date'], dtype='object')
cowidev.vax.incremental.macao ❌ 2023-06-16T07:03:25 6.53
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 90, in main
    Macao().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 75, in export
    data = self.read()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 23, in read
    iframe_url = self._get_iframe_url(driver)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 31, in _get_iframe_url
    elem = driver.find_element_by_id("ICovid19Monitor")
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py", line 360, in find_element_by_id
    return self.find_element(by=By.ID, value=id_)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
    return self.execute(Command.FIND_ELEMENT, {
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"[id="ICovid19Monitor"]"}
  (Session info: headless chrome=114.0.5735.106)
cowidev.vax.incremental.dominican_republic ❌ 2023-06-16T07:03:17 13.06
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 112, in main
    DominicanRepublic().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 68, in export
    data = self.read().pipe(self.pipeline)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 26, in read
    metrics = self._parse_metrics(driver)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 35, in _parse_metrics
    metric_candidates = _find_potential_metrics(driver)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 91, in _find_potential_metrics
    h3 = _find_h3(driver)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 81, in _find_h3
    raise ValueError("More than one element found!")
ValueError: More than one element found!
cowidev.vax.batch.united_kingdom ❌ 2023-06-16T07:02:23 3.94
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/united_kingdom.py", line 156, in main
    UnitedKingdom().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/united_kingdom.py", line 144, in export
    raise (e)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/united_kingdom.py", line 141, in export
    df = df.pipe(self.make_monotonic, max_removed_rows=max_removed_rows_dict[location])
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/base.py", line 120, in make_monotonic
    return mkm(
  File "/home/owid/covid-19-data/scripts/src/cowidev/utils/utils.py", line 23, in make_monotonic
    return make_monotonic_new(df, column_date, column_metrics, max_removed_rows)
  File "/home/owid/covid-19-data/scripts/src/cowidev/utils/utils.py", line 96, in make_monotonic_new
    raise Exception(
Exception: 1 chunks of lengths 261 would be NaNed for metric total_boosters. That is more than maximum allowed (10) by make_monotonic() - check the data. Check dates ['2023-05-31']. Location(s) affected: {'England'}
cowidev.vax.batch.south_korea ❌ 2023-06-16T07:02:19 13.38
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/south_korea.py", line 209, in main
    SouthKorea().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/south_korea.py", line 191, in export
    df_base = self.read().pipe(self.pipeline_base)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/south_korea.py", line 109, in pipeline_base
    .pipe(self.pipe_check_metrics)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/south_korea.py", line 92, in pipe_check_metrics
    raise ValueError(f"Metric {dose} for 'all' is not equal to the sum over all vaccines (2% tolerance).")
ValueError: Metric dose_1 for 'all' is not equal to the sum over all vaccines (2% tolerance).
cowidev.vax.batch.japan ❌ 2023-06-16T07:02:06 9.29
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 375, in main
    Japan().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 359, in export
    df = self.read().pipe(self.pipeline_base)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 71, in read
    df_latest = self.read_latest().pipe(self.pipe_read_latest)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 100, in read_latest
    self._read_latest_booster(),
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 211, in _read_latest_booster
    df = self._read_xlsx(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/japan.py", line 233, in _read_xlsx
    raise ValueError(f"Unknown sheets: {sheets_unknown}")
ValueError: Unknown sheets: {'5.8以降接種_一般接種（６回目）', '６回目_総接種回数', '５回目_一般接種回数', '5.8以降接種_総接種回数', '５回目_総接種回数', '5.8以降接種_一般接種（５回目）', '5.8以降接種_一般接種（３回目）', '６回目_一般接種回数', '5.8以降接種_一般接種（４回目）'}
cowidev.vax.batch.canada ❌ 2023-06-16T07:01:57 5.58
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/canada.py", line 282, in main
    Canada().export()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/canada.py", line 270, in export
    df = df.pipe(self.pipeline, df_man)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/canada.py", line 250, in pipeline
    .pipe(self.pipe_make_monotonic)[
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/batch/canada.py", line 230, in pipe_make_monotonic
    df = df.pipe(self.make_monotonic, max_removed_rows=self.max_removed_rows)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/base.py", line 120, in make_monotonic
    return mkm(
  File "/home/owid/covid-19-data/scripts/src/cowidev/utils/utils.py", line 23, in make_monotonic
    return make_monotonic_new(df, column_date, column_metrics, max_removed_rows)
  File "/home/owid/covid-19-data/scripts/src/cowidev/utils/utils.py", line 96, in make_monotonic_new
    raise Exception(
Exception: 1 chunks of lengths 36 would be NaNed for metric people_vaccinated. That is more than maximum allowed (22) by make_monotonic() - check the data. Check dates ['2023-01-26']. Location(s) affected: {'Canada'}
cowidev.vax.incremental.turkey ⚠️ 2023-06-16T07:00:21 NaN
cowidev.vax.incremental.united_arab_emirates ⚠️ 2023-06-16T07:00:21 NaN
cowidev.vax.incremental.vietnam ⚠️ 2023-06-16T07:00:21 NaN
cowidev.vax.incremental.saint_lucia ⚠️ 2023-06-16T07:00:19 NaN
cowidev.vax.incremental.south_africa ⚠️ 2023-06-16T07:00:19 NaN
cowidev.vax.incremental.sri_lanka ⚠️ 2023-06-16T07:00:19 NaN
cowidev.vax.incremental.morocco ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.myanmar ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.nepal ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.north_macedonia ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.pakistan ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.philippines ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.qatar ⚠️ 2023-06-16T07:00:17 NaN
cowidev.vax.incremental.kosovo ⚠️ 2023-06-16T07:00:16 NaN
cowidev.vax.incremental.moldova ⚠️ 2023-06-16T07:00:16 NaN
cowidev.vax.incremental.greenland ⚠️ 2023-06-16T07:00:15 NaN
cowidev.vax.incremental.guatemala ⚠️ 2023-06-16T07:00:15 NaN
cowidev.vax.incremental.guernsey ⚠️ 2023-06-16T07:00:15 NaN
cowidev.vax.incremental.iran ⚠️ 2023-06-16T07:00:15 NaN
cowidev.vax.incremental.gabon ⚠️ 2023-06-16T07:00:14 NaN
cowidev.vax.incremental.curacao ⚠️ 2023-06-16T07:00:12 NaN
cowidev.vax.incremental.barbados ⚠️ 2023-06-16T07:00:11 NaN
cowidev.vax.incremental.costa_rica ⚠️ 2023-06-16T07:00:11 NaN
cowidev.vax.incremental.africacdc ⚠️ 2023-06-16T07:00:10 NaN
cowidev.vax.incremental.antigua_barbuda ⚠️ 2023-06-16T07:00:10 NaN
cowidev.vax.incremental.austria ⚠️ 2023-06-16T07:00:10 NaN
cowidev.vax.incremental.azerbaijan ⚠️ 2023-06-16T07:00:10 NaN
cowidev.vax.incremental.bahrain ⚠️ 2023-06-16T07:00:10 NaN
cowidev.vax.batch.ukraine ⚠️ 2023-06-16T07:00:07 NaN
cowidev.vax.batch.australia ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.austria_old ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.denmark ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.ecuador ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.indonesia ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.netherlands ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.batch.portugal ⚠️ 2023-06-16T07:00:06 NaN
cowidev.vax.incremental.laos ✅ 2023-06-16T07:03:18 1.80
cowidev.vax.incremental.bangladesh ✅ 2023-06-16T07:03:03 40.32
cowidev.vax.incremental.monaco ✅ 2023-06-16T07:01:38 81.25
cowidev.vax.incremental.hungary ✅ 2023-06-16T07:01:36 81.24
cowidev.vax.batch.ecdc ✅ 2023-06-16T07:01:34 87.39
cowidev.vax.batch.switzerland ✅ 2023-06-16T07:01:03 56.15
cowidev.vax.batch.slovakia ✅ 2023-06-16T07:00:55 48.60
cowidev.vax.batch.latvia ✅ 2023-06-16T07:00:52 46.15
cowidev.vax.incremental.who ✅ 2023-06-16T07:00:51 30.13
cowidev.vax.incremental.russia ✅ 2023-06-16T07:00:42 24.35
cowidev.vax.batch.czechia ✅ 2023-06-16T07:00:36 29.44
cowidev.vax.incremental.suriname ✅ 2023-06-16T07:00:34 14.98
cowidev.vax.batch.romania ✅ 2023-06-16T07:00:31 24.74
cowidev.vax.incremental.spain ✅ 2023-06-16T07:00:31 11.39
cowidev.vax.batch.greece ✅ 2023-06-16T07:00:29 22.84
cowidev.vax.incremental.china ✅ 2023-06-16T07:00:29 17.90
cowidev.vax.batch.united_states ✅ 2023-06-16T07:00:27 19.81
cowidev.vax.incremental.serbia ✅ 2023-06-16T07:00:26 7.68
cowidev.vax.incremental.thailand ✅ 2023-06-16T07:00:26 5.07
cowidev.vax.incremental.jamaica ✅ 2023-06-16T07:00:25 10.12
cowidev.vax.batch.argentina ✅ 2023-06-16T07:00:23 16.45
cowidev.vax.incremental.kazakhstan ✅ 2023-06-16T07:00:23 8.38
cowidev.vax.incremental.northern_cyprus ✅ 2023-06-16T07:00:23 6.58
cowidev.vax.incremental.zambia ✅ 2023-06-16T07:00:23 1.49
cowidev.vax.batch.hong_kong ✅ 2023-06-16T07:00:22 15.71
cowidev.vax.batch.new_zealand ✅ 2023-06-16T07:00:21 15.15
cowidev.vax.incremental.kyrgyzstan ✅ 2023-06-16T07:00:21 5.32
cowidev.vax.batch.spc ✅ 2023-06-16T07:00:20 13.22
cowidev.vax.batch.sweden ✅ 2023-06-16T07:00:19 12.87
cowidev.vax.incremental.isle_of_man ✅ 2023-06-16T07:00:19 3.84
cowidev.vax.incremental.poland ✅ 2023-06-16T07:00:19 2.11
cowidev.vax.batch.saudi_arabia ✅ 2023-06-16T07:00:17 10.42
cowidev.vax.incremental.el_salvador ✅ 2023-06-16T07:00:17 3.98
cowidev.vax.incremental.mongolia ✅ 2023-06-16T07:00:17 1.01
cowidev.vax.incremental.montenegro ✅ 2023-06-16T07:00:17 0.63
cowidev.vax.incremental.bulgaria ✅ 2023-06-16T07:00:16 5.39
cowidev.vax.incremental.cuba ✅ 2023-06-16T07:00:16 4.47
cowidev.vax.incremental.georgia ✅ 2023-06-16T07:00:16 1.59
cowidev.vax.incremental.india ✅ 2023-06-16T07:00:16 1.57
cowidev.vax.incremental.iceland ✅ 2023-06-16T07:00:16 1.04
cowidev.vax.batch.italy ✅ 2023-06-16T07:00:15 8.72
cowidev.vax.batch.israel ✅ 2023-06-16T07:00:15 8.65
cowidev.vax.batch.belgium ✅ 2023-06-16T07:00:15 8.55
cowidev.vax.batch.uruguay ✅ 2023-06-16T07:00:15 6.59
cowidev.vax.incremental.cyprus ✅ 2023-06-16T07:00:15 3.03
cowidev.vax.incremental.finland ✅ 2023-06-16T07:00:15 0.52
cowidev.vax.batch.france ✅ 2023-06-16T07:00:14 7.99
cowidev.vax.incremental.faeroe_islands ✅ 2023-06-16T07:00:14 1.13
cowidev.vax.incremental.fiji ✅ 2023-06-16T07:00:14 0.00
cowidev.vax.incremental.aruba ✅ 2023-06-16T07:00:13 2.83
cowidev.vax.incremental.croatia ✅ 2023-06-16T07:00:13 1.95
cowidev.vax.batch.lithuania ✅ 2023-06-16T07:00:12 5.43
cowidev.vax.incremental.brazil ✅ 2023-06-16T07:00:12 1.19
cowidev.vax.batch.ireland ✅ 2023-06-16T07:00:11 5.05
cowidev.vax.batch.jersey ✅ 2023-06-16T07:00:11 4.77
cowidev.vax.batch.peru ✅ 2023-06-16T07:00:11 4.68
cowidev.vax.batch.trinidad_and_tobago ✅ 2023-06-16T07:00:11 4.39
cowidev.vax.batch.zimbabwe ✅ 2023-06-16T07:00:11 2.03
cowidev.vax.batch.bolivia ✅ 2023-06-16T07:00:10 3.94
cowidev.vax.batch.singapore ✅ 2023-06-16T07:00:10 3.91
cowidev.vax.batch.luxembourg ✅ 2023-06-16T07:00:09 2.79
cowidev.vax.batch.slovenia ✅ 2023-06-16T07:00:08 2.00
cowidev.vax.batch.malta ✅ 2023-06-16T07:00:07 1.16
cowidev.vax.batch.chile ✅ 2023-06-16T07:00:07 0.94
cowidev.vax.batch.estonia ✅ 2023-06-16T07:00:07 0.87
cowidev.vax.batch.malaysia ✅ 2023-06-16T07:00:07 0.81
cowidev.vax.batch.norway ✅ 2023-06-16T07:00:07 0.39
cowidev.vax.batch.germany ✅ 2023-06-16T07:00:06 0.20

Process (Checks)

6/223 processes failed, 0/223 were skipped. Latest update was 2023-06-16T07:05:03.

location status timestamp error
United Kingdom ❌ 2023-06-16T07:05:03
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 169, in check_metrics
    self._check_metrics_monotonic(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 185, in _check_metrics_monotonic
    raise ValueError(
ValueError: United Kingdom -- Column people_vaccinated must be monotonically increasing! Check:
           location       date  ... people_fully_vaccinated total_boosters
437  United Kingdom 2022-03-23  ...                49341160       38701747
610  United Kingdom 2023-04-03  ...                42951064       33906503

[2 rows x 8 columns]
New Zealand ❌ 2023-06-16T07:05:01
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 171, in check_metrics
    self._check_metrics_inequalities(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 209, in _check_metrics_inequalities
    raise ValueError(
ValueError: New Zealand -- people_vaccinated can't be < people_fully_vaccinated!
        location       date  ... people_fully_vaccinated total_boosters
792  New Zealand 2023-04-19  ...                 4303264        3616334
793  New Zealand 2023-04-20  ...                 4314635        3621501
794  New Zealand 2023-04-21  ...                 4324426        3626739
795  New Zealand 2023-04-22  ...                 4327657        3629325
796  New Zealand 2023-04-23  ...                 4328446        3630146
797  New Zealand 2023-04-24  ...                 4336847        3634962
798  New Zealand 2023-04-25  ...                 4337184        3635249
799  New Zealand 2023-04-26  ...                 4347391        3640084
800  New Zealand 2023-04-27  ...                 4357407        3645035
801  New Zealand 2023-04-28  ...                 4366398        3650036
802  New Zealand 2023-04-29  ...                 4369093        3652410
803  New Zealand 2023-04-30  ...                 4369725        3653233
804  New Zealand 2023-05-01  ...                 4376276        3656872
805  New Zealand 2023-05-02  ...                 4383698        3660870

[14 rows x 8 columns]
Nicaragua ❌ 2023-06-16T07:05:01
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 169, in check_metrics
    self._check_metrics_monotonic(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 185, in _check_metrics_monotonic
    raise ValueError(
ValueError: Nicaragua -- Column total_boosters must be monotonically increasing! Check:
      location       date  ... people_fully_vaccinated total_boosters
100  Nicaragua 2023-06-02  ...                 6117158        2892531

[1 rows x 8 columns]
Honduras ❌ 2023-06-16T07:04:59
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 169, in check_metrics
    self._check_metrics_monotonic(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 185, in _check_metrics_monotonic
    raise ValueError(
ValueError: Honduras -- Column total_vaccinations must be monotonically increasing! Check:
     location       date  ... people_fully_vaccinated total_boosters
105  Honduras 2023-06-02  ...                 5751048        4665196

[1 rows x 8 columns]
Ireland ❌ 2023-06-16T07:04:59
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 169, in check_metrics
    self._check_metrics_monotonic(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 185, in _check_metrics_monotonic
    raise ValueError(
ValueError: Ireland -- Column total_vaccinations must be monotonically increasing! Check:
    location       date  ... people_fully_vaccinated total_boosters
804  Ireland 2023-03-26  ...                 4062167              0
831  Ireland 2023-04-26  ...                 4062630              0

[2 rows x 8 columns]
Finland ❌ 2023-06-16T07:04:58
show
Traceback (most recent call last):
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/process.py", line 92, in _process_location_and_move_file
    df = process_location(df, monotonic_check_skip, anomaly_check_skip)
  File "/home/owid/covid-19-data/scripts/src/cowidev/cmd/vax/process/utils.py", line 57, in process_location
    country_df_sanity_checks(
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 72, in country_df_sanity_checks
    checker.run()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 252, in run
    self.check_metrics()
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 169, in check_metrics
    self._check_metrics_monotonic(df)
  File "/home/owid/covid-19-data/scripts/src/cowidev/vax/utils/checks.py", line 185, in _check_metrics_monotonic
    raise ValueError(
ValueError: Finland -- Column people_vaccinated must be monotonically increasing! Check:
    location       date  ... people_fully_vaccinated total_boosters
178  Finland 2023-06-15  ...                 4348010           

[1 rows x 8 columns]
Tajikistan ✅ 2023-06-16T07:05:03
Tanzania ✅ 2023-06-16T07:05:03
Thailand ✅ 2023-06-16T07:05:03
Timor ✅ 2023-06-16T07:05:03
Tokelau ✅ 2023-06-16T07:05:03
Togo ✅ 2023-06-16T07:05:03
Tonga ✅ 2023-06-16T07:05:03
Trinidad and Tobago ✅ 2023-06-16T07:05:03
Tunisia ✅ 2023-06-16T07:05:03
Turkey ✅ 2023-06-16T07:05:03
Turkmenistan ✅ 2023-06-16T07:05:03
Turks and Caicos Islands ✅ 2023-06-16T07:05:03
Tuvalu ✅ 2023-06-16T07:05:03
Uganda ✅ 2023-06-16T07:05:03
Ukraine ✅ 2023-06-16T07:05:03
United Arab Emirates ✅ 2023-06-16T07:05:03
United States ✅ 2023-06-16T07:05:03
Uruguay ✅ 2023-06-16T07:05:03
Uzbekistan ✅ 2023-06-16T07:05:03
Vanuatu ✅ 2023-06-16T07:05:03
Venezuela ✅ 2023-06-16T07:05:03
Vietnam ✅ 2023-06-16T07:05:03
Wales ✅ 2023-06-16T07:05:03
Wallis and Futuna ✅ 2023-06-16T07:05:03
Yemen ✅ 2023-06-16T07:05:03
Zambia ✅ 2023-06-16T07:05:03
Zimbabwe ✅ 2023-06-16T07:05:03
Saint Vincent and the Grenadines ✅ 2023-06-16T07:05:02
Samoa ✅ 2023-06-16T07:05:02
San Marino ✅ 2023-06-16T07:05:02
Sao Tome and Principe ✅ 2023-06-16T07:05:02
Saudi Arabia ✅ 2023-06-16T07:05:02
Scotland ✅ 2023-06-16T07:05:02
Senegal ✅ 2023-06-16T07:05:02
Serbia ✅ 2023-06-16T07:05:02
Seychelles ✅ 2023-06-16T07:05:02
Sierra Leone ✅ 2023-06-16T07:05:02
Singapore ✅ 2023-06-16T07:05:02
Sint Maarten (Dutch part) ✅ 2023-06-16T07:05:02
Slovakia ✅ 2023-06-16T07:05:02
Slovenia ✅ 2023-06-16T07:05:02
Solomon Islands ✅ 2023-06-16T07:05:02
Somalia ✅ 2023-06-16T07:05:02
South Africa ✅ 2023-06-16T07:05:02
South Korea ✅ 2023-06-16T07:05:02
South Sudan ✅ 2023-06-16T07:05:02
Spain ✅ 2023-06-16T07:05:02
Sri Lanka ✅ 2023-06-16T07:05:02
Sudan ✅ 2023-06-16T07:05:02
Suriname ✅ 2023-06-16T07:05:02
Sweden ✅ 2023-06-16T07:05:02
Switzerland ✅ 2023-06-16T07:05:02
Syria ✅ 2023-06-16T07:05:02
Taiwan ✅ 2023-06-16T07:05:02
New Caledonia ✅ 2023-06-16T07:05:01
Niger ✅ 2023-06-16T07:05:01
Nigeria ✅ 2023-06-16T07:05:01
North Macedonia ✅ 2023-06-16T07:05:01
Northern Cyprus ✅ 2023-06-16T07:05:01
Northern Ireland ✅ 2023-06-16T07:05:01
Norway ✅ 2023-06-16T07:05:01
Niue ✅ 2023-06-16T07:05:01
Oman ✅ 2023-06-16T07:05:01
Pakistan ✅ 2023-06-16T07:05:01
Palestine ✅ 2023-06-16T07:05:01
Panama ✅ 2023-06-16T07:05:01
Papua New Guinea ✅ 2023-06-16T07:05:01
Paraguay ✅ 2023-06-16T07:05:01
Peru ✅ 2023-06-16T07:05:01
Philippines ✅ 2023-06-16T07:05:01
Pitcairn ✅ 2023-06-16T07:05:01
Poland ✅ 2023-06-16T07:05:01
Portugal ✅ 2023-06-16T07:05:01
Qatar ✅ 2023-06-16T07:05:01
Romania ✅ 2023-06-16T07:05:01
Russia ✅ 2023-06-16T07:05:01
Rwanda ✅ 2023-06-16T07:05:01
Saint Helena ✅ 2023-06-16T07:05:01
Saint Kitts and Nevis ✅ 2023-06-16T07:05:01
Saint Lucia ✅ 2023-06-16T07:05:01
Liberia ✅ 2023-06-16T07:05:00
Libya ✅ 2023-06-16T07:05:00
Liechtenstein ✅ 2023-06-16T07:05:00
Lithuania ✅ 2023-06-16T07:05:00
Luxembourg ✅ 2023-06-16T07:05:00
Macao ✅ 2023-06-16T07:05:00
Madagascar ✅ 2023-06-16T07:05:00
Malawi ✅ 2023-06-16T07:05:00
Malaysia ✅ 2023-06-16T07:05:00
Maldives ✅ 2023-06-16T07:05:00
Mali ✅ 2023-06-16T07:05:00
Malta ✅ 2023-06-16T07:05:00
Mauritania ✅ 2023-06-16T07:05:00
Mauritius ✅ 2023-06-16T07:05:00
Mexico ✅ 2023-06-16T07:05:00
Moldova ✅ 2023-06-16T07:05:00
Monaco ✅ 2023-06-16T07:05:00
Mongolia ✅ 2023-06-16T07:05:00
Montenegro ✅ 2023-06-16T07:05:00
Montserrat ✅ 2023-06-16T07:05:00
Morocco ✅ 2023-06-16T07:05:00
Mozambique ✅ 2023-06-16T07:05:00
Myanmar ✅ 2023-06-16T07:05:00
Namibia ✅ 2023-06-16T07:05:00
Nauru ✅ 2023-06-16T07:05:00
Nepal ✅ 2023-06-16T07:05:00
Netherlands ✅ 2023-06-16T07:05:00
Haiti ✅ 2023-06-16T07:04:59
Hong Kong ✅ 2023-06-16T07:04:59
Hungary ✅ 2023-06-16T07:04:59
Iceland ✅ 2023-06-16T07:04:59
India ✅ 2023-06-16T07:04:59
Indonesia ✅ 2023-06-16T07:04:59
Iran ✅ 2023-06-16T07:04:59
Iraq ✅ 2023-06-16T07:04:59
Isle of Man ✅ 2023-06-16T07:04:59
Israel ✅ 2023-06-16T07:04:59
Italy ✅ 2023-06-16T07:04:59
Jamaica ✅ 2023-06-16T07:04:59
Japan ✅ 2023-06-16T07:04:59
Jersey ✅ 2023-06-16T07:04:59
Jordan ✅ 2023-06-16T07:04:59
Kazakhstan ✅ 2023-06-16T07:04:59
Kenya ✅ 2023-06-16T07:04:59
Kiribati ✅ 2023-06-16T07:04:59
Kosovo ✅ 2023-06-16T07:04:59
Kuwait ✅ 2023-06-16T07:04:59
Kyrgyzstan ✅ 2023-06-16T07:04:59
Laos ✅ 2023-06-16T07:04:59
Latvia ✅ 2023-06-16T07:04:59
Lebanon ✅ 2023-06-16T07:04:59
Lesotho ✅ 2023-06-16T07:04:59
Ecuador ✅ 2023-06-16T07:04:58
Egypt ✅ 2023-06-16T07:04:58
El Salvador ✅ 2023-06-16T07:04:58
England ✅ 2023-06-16T07:04:58
Equatorial Guinea ✅ 2023-06-16T07:04:58
Estonia ✅ 2023-06-16T07:04:58
Eswatini ✅ 2023-06-16T07:04:58
Ethiopia ✅ 2023-06-16T07:04:58
Faeroe Islands ✅ 2023-06-16T07:04:58
Falkland Islands ✅ 2023-06-16T07:04:58
Fiji ✅ 2023-06-16T07:04:58
France ✅ 2023-06-16T07:04:58
French Polynesia ✅ 2023-06-16T07:04:58
Gabon ✅ 2023-06-16T07:04:58
Gambia ✅ 2023-06-16T07:04:58
Georgia ✅ 2023-06-16T07:04:58
Germany ✅ 2023-06-16T07:04:58
Ghana ✅ 2023-06-16T07:04:58
Gibraltar ✅ 2023-06-16T07:04:58
Greece ✅ 2023-06-16T07:04:58
Greenland ✅ 2023-06-16T07:04:58
Grenada ✅ 2023-06-16T07:04:58
Guatemala ✅ 2023-06-16T07:04:58
Guernsey ✅ 2023-06-16T07:04:58
Guinea ✅ 2023-06-16T07:04:58
Guinea-Bissau ✅ 2023-06-16T07:04:58
Guyana ✅ 2023-06-16T07:04:58
Bulgaria ✅ 2023-06-16T07:04:57
Burkina Faso ✅ 2023-06-16T07:04:57
Burundi ✅ 2023-06-16T07:04:57
Cambodia ✅ 2023-06-16T07:04:57
Cameroon ✅ 2023-06-16T07:04:57
Canada ✅ 2023-06-16T07:04:57
Cape Verde ✅ 2023-06-16T07:04:57
Cayman Islands ✅ 2023-06-16T07:04:57
Central African Republic ✅ 2023-06-16T07:04:57
Chad ✅ 2023-06-16T07:04:57
Chile ✅ 2023-06-16T07:04:57
China ✅ 2023-06-16T07:04:57
Colombia ✅ 2023-06-16T07:04:57
Comoros ✅ 2023-06-16T07:04:57
Congo ✅ 2023-06-16T07:04:57
Cook Islands ✅ 2023-06-16T07:04:57
Costa Rica ✅ 2023-06-16T07:04:57
Cote d'Ivoire ✅ 2023-06-16T07:04:57
Croatia ✅ 2023-06-16T07:04:57
Cuba ✅ 2023-06-16T07:04:57
Curacao ✅ 2023-06-16T07:04:57
Cyprus ✅ 2023-06-16T07:04:57
Czechia ✅ 2023-06-16T07:04:57
Democratic Republic of Congo ✅ 2023-06-16T07:04:57
Denmark ✅ 2023-06-16T07:04:57
Djibouti ✅ 2023-06-16T07:04:57
Dominica ✅ 2023-06-16T07:04:57
Dominican Republic ✅ 2023-06-16T07:04:57
Algeria ✅ 2023-06-16T07:04:56
Andorra ✅ 2023-06-16T07:04:56
Angola ✅ 2023-06-16T07:04:56
Anguilla ✅ 2023-06-16T07:04:56
Antigua and Barbuda ✅ 2023-06-16T07:04:56
Argentina ✅ 2023-06-16T07:04:56
Armenia ✅ 2023-06-16T07:04:56
Aruba ✅ 2023-06-16T07:04:56
Australia ✅ 2023-06-16T07:04:56
Austria ✅ 2023-06-16T07:04:56
Azerbaijan ✅ 2023-06-16T07:04:56
Bahamas ✅ 2023-06-16T07:04:56
Bahrain ✅ 2023-06-16T07:04:56
Bangladesh ✅ 2023-06-16T07:04:56
Barbados ✅ 2023-06-16T07:04:56
Belarus ✅ 2023-06-16T07:04:56
Belgium ✅ 2023-06-16T07:04:56
Belize ✅ 2023-06-16T07:04:56
Benin ✅ 2023-06-16T07:04:56
Bermuda ✅ 2023-06-16T07:04:56
Bhutan ✅ 2023-06-16T07:04:56
Bolivia ✅ 2023-06-16T07:04:56
Bonaire Sint Eustatius and Saba ✅ 2023-06-16T07:04:56
Bosnia and Herzegovina ✅ 2023-06-16T07:04:56
Botswana ✅ 2023-06-16T07:04:56
Brazil ✅ 2023-06-16T07:04:56
British Virgin Islands ✅ 2023-06-16T07:04:56
Brunei ✅ 2023-06-16T07:04:56
Afghanistan ✅ 2023-06-16T07:04:55
Albania ✅ 2023-06-16T07:04:55

Testing

Get (scraping)

18/130 scripts failed, 9/130 were skipped. Latest update was 2022-08-10T14:33:15.

module status timestamp execution_time (sec) error
cowidev.testing.batch.hong_kong ❌ 2022-06-23T13:00:51 0.23
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/hong_kong.py", line 84, in main
    HongKong().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/hong_kong.py", line 79, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/hong_kong.py", line 24, in read
    return pd.read_csv(self.source_url)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/util/_decorators.py", line 311, in wrapper
    return func(*args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 482, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 811, in __init__
    self._engine = self._make_engine(self.engine)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine
    return mapping[engine](self.f, **self.options)  # type: ignore[call-arg]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 51, in __init__
    self._open_handles(src, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/base_parser.py", line 222, in _open_handles
    self.handles = get_handle(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 609, in get_handle
    ioargs = _get_filepath_or_buffer(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 312, in _get_filepath_or_buffer
    with urlopen(req_info) as req:
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 212, in urlopen
    return urllib.request.urlopen(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
cowidev.testing.batch.canada ❌ 2022-06-23T12:59:16 0.64
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/canada.py", line 67, in main
    Canada().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/canada.py", line 57, in export
    df = self.read()  # .pipe(self.pipeline_base)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/canada.py", line 31, in read
    df = pd.read_csv(data, usecols=["prname", "date", "numtested", "numtests"])
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/util/_decorators.py", line 311, in wrapper
    return func(*args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 482, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 811, in __init__
    self._engine = self._make_engine(self.engine)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine
    return mapping[engine](self.f, **self.options)  # type: ignore[call-arg]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 135, in __init__
    self._validate_usecols_names(usecols, self.orig_names)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/base_parser.py", line 866, in _validate_usecols_names
    raise ValueError(
ValueError: Usecols do not match columns, columns expected but not found: ['numtests', 'numtested']
cowidev.testing.batch.costa_rica ❌ 2022-06-23T12:58:49 0.74
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/costa_rica.py", line 60, in main
    CostaRica().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/costa_rica.py", line 55, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/costa_rica.py", line 17, in read
    df = pd.read_csv(self.source_url, delimiter=";", usecols=["nue_posi", "conf_nexo", "nue_descar", "FECHA"])
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/util/_decorators.py", line 311, in wrapper
    return func(*args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 482, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 811, in __init__
    self._engine = self._make_engine(self.engine)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine
    return mapping[engine](self.f, **self.options)  # type: ignore[call-arg]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 51, in __init__
    self._open_handles(src, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/base_parser.py", line 222, in _open_handles
    self.handles = get_handle(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 609, in get_handle
    ioargs = _get_filepath_or_buffer(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 312, in _get_filepath_or_buffer
    with urlopen(req_info) as req:
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 212, in urlopen
    return urllib.request.urlopen(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404:
cowidev.testing.batch.spain ❌ 2022-06-23T12:58:30 1.19
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/spain.py", line 51, in main
    Spain().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/spain.py", line 46, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/spain.py", line 19, in read
    df = pd.read_csv(self.test_url, encoding="cp1252", delimiter=";")
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/util/_decorators.py", line 311, in wrapper
    return func(*args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 482, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 811, in __init__
    self._engine = self._make_engine(self.engine)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine
    return mapping[engine](self.f, **self.options)  # type: ignore[call-arg]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 51, in __init__
    self._open_handles(src, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/base_parser.py", line 222, in _open_handles
    self.handles = get_handle(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 609, in get_handle
    ioargs = _get_filepath_or_buffer(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 312, in _get_filepath_or_buffer
    with urlopen(req_info) as req:
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 212, in urlopen
    return urllib.request.urlopen(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not found
cowidev.testing.incremental.syria ❌ 2022-06-23T12:39:51 0.85
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/syria.py", line 104, in main
    Syria().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/syria.py", line 91, in export
    data = self.read()[0]
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/syria.py", line 29, in read
    data = self._parse_data(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/syria.py", line 36, in _parse_data
    elem = self._get_relevant_element(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/syria.py", line 54, in _get_relevant_element
    elem = soup.find_all("h4", "title")[0].find("a")
IndexError: list index out of range
cowidev.testing.incremental.russia ❌ 2022-06-23T12:39:50 40.02
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 95, in create_connection
    raise err
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection
    sock.connect(sa)
TimeoutError: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 179, in _new_conn
    raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (, 'Connection to rospotrebnadzor.ru timed out. (connect timeout=20)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/adapters.py", line 440, in send
    resp = conn.urlopen(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='rospotrebnadzor.ru', port=443): Max retries exceeded with url: /about/info/news/?PAGEN_1=1 (Caused by ConnectTimeoutError(, 'Connection to rospotrebnadzor.ru timed out. (connect timeout=20)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/russia.py", line 104, in main
    Russia().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/russia.py", line 91, in export
    data = self.read()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/russia.py", line 30, in read
    soup = get_soup(url)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 83, in get_soup
    response = get_response(source, request_method, use_proxy, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 49, in get_response
    raise err
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 43, in get_response
    response = requests.get(source, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/sessions.py", line 529, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/sessions.py", line 645, in send
    r = adapter.send(request, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/adapters.py", line 507, in send
    raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='rospotrebnadzor.ru', port=443): Max retries exceeded with url: /about/info/news/?PAGEN_1=1 (Caused by ConnectTimeoutError(, 'Connection to rospotrebnadzor.ru timed out. (connect timeout=20)'))
cowidev.testing.incremental.mongolia ❌ 2022-06-23T12:39:10 2.26
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/mongolia.py", line 31, in main
    Mongolia().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/mongolia.py", line 19, in export
    increment(
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/utils/incremental.py", line 50, in increment
    _check_fields(df_current, country, source_url, source_label, units, date, count, daily_change)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/utils/incremental.py", line 111, in _check_fields
    raise ValueError(f"`cumulative_total` can't be lower than currently highers 'Cumulative total' value.")
ValueError: `cumulative_total` can't be lower than currently highers 'Cumulative total' value.
cowidev.testing.incremental.papua_new_guinea ❌ 2022-06-23T12:39:10 0.01
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/socket.py", line 955, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 8] nodename nor servname provided, or not known

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/adapters.py", line 440, in send
    resp = conn.urlopen(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='covid19.info.gov.pg', port=443): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/papua_new_guinea.py", line 54, in main
    PapuaNewGuinea().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/papua_new_guinea.py", line 41, in export
    data = self.read()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/papua_new_guinea.py", line 21, in read
    soup = get_soup(self.source_url)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 83, in get_soup
    response = get_response(source, request_method, use_proxy, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 49, in get_response
    raise err
  File "/Users/cam/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 43, in get_response
    response = requests.get(source, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/sessions.py", line 529, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/sessions.py", line 645, in send
    r = adapter.send(request, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/requests/adapters.py", line 519, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='covid19.info.gov.pg', port=443): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known'))
cowidev.testing.incremental.moldova ❌ 2022-06-23T12:39:08 6.31
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/moldova.py", line 100, in main
    Moldova().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/moldova.py", line 86, in export
    data = self.read()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/moldova.py", line 27, in read
    data = self._parse_data(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/moldova.py", line 33, in _parse_data
    url = self._get_relevant_element(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/moldova.py", line 55, in _get_relevant_element
    if not link:
UnboundLocalError: local variable 'link' referenced before assignment
cowidev.testing.incremental.jordan ❌ 2022-06-23T12:39:02 1.26
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/jordan.py", line 25, in read
    count = self._request()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/jordan.py", line 110, in _request
    response = json.loads(
KeyError: 'results'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/jordan.py", line 147, in main
    Jordan().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/jordan.py", line 141, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/jordan.py", line 28, in read
    raise KeyError("No value found. Please modify the payload and headers.")
KeyError: 'No value found. Please modify the payload and headers.'
cowidev.testing.incremental.georgia ❌ 2022-06-23T12:39:00 6.88
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3361, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 76, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 108, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'date'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/georgia.py", line 115, in main
    Georgia().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/georgia.py", line 107, in export
    date=data["date"],
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/series.py", line 942, in __getitem__
    return self._get_value(key)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/series.py", line 1051, in _get_value
    loc = self.index.get_loc(label)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3363, in get_loc
    raise KeyError(key) from err
KeyError: 'date'
cowidev.testing.incremental.emro ❌ 2022-06-23T12:38:54 11.65
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/emro.py", line 155, in main
    EMRO().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/emro.py", line 150, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/emro.py", line 54, in read
    df = self._parse_data(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/emro.py", line 66, in _parse_data
    df = self._parse_metrics(df_list)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/emro.py", line 92, in _parse_metrics
    df = [table for table in df_list if self.columns_to_check["tests"] in table.columns][0]
IndexError: list index out of range
cowidev.testing.incremental.cambodia ❌ 2022-06-23T12:38:42 6.87
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/cambodia.py", line 41, in main
    Cambodia().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/cambodia.py", line 19, in export
    count = clean_count(soup.select("p+ div strong:nth-child(1)")[0].text)
IndexError: list index out of range
cowidev.testing.incremental.belarus ❌ 2022-06-23T12:38:35 2.77
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/belarus.py", line 70, in main
    Belarus().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/belarus.py", line 65, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/belarus.py", line 24, in read
    df = self._parse_data(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/belarus.py", line 30, in _parse_data
    elem = soup.find(text=self.regex["element"]).parent
AttributeError: 'NoneType' object has no attribute 'parent'
cowidev.testing.incremental.barbados ❌ 2022-06-23T12:38:32 1.54
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/barbados.py", line 72, in main
    Barbados().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/barbados.py", line 67, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/barbados.py", line 24, in read
    df = self._parse_data(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/barbados.py", line 36, in _parse_data
    count = self._parse_metrics(soup)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/incremental/barbados.py", line 51, in _parse_metrics
    count = re.search(self.regex["count"], text).group(1)
AttributeError: 'NoneType' object has no attribute 'group'
cowidev.testing.batch.turkey ❌ 2022-06-23T12:38:31 17.08
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/turkey.py", line 64, in main
    Turkey().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/turkey.py", line 59, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/turkey.py", line 55, in pipeline
    df = df.pipe(self.pipe_filter).pipe(self.pipe_rename_columns).pipe(self.pipe_date).pipe(self.pipe_metadata)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/turkey.py", line 33, in pipe_filter
    return df[["Tarih", "Bugünkü Test Sayısı"]].dropna()
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/frame.py", line 3464, in __getitem__
    indexer = self.loc._get_listlike_indexer(key, axis=1)[1]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexing.py", line 1314, in _get_listlike_indexer
    self._validate_read_indexer(keyarr, indexer, axis)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexing.py", line 1377, in _validate_read_indexer
    raise KeyError(f"{not_found} not in index")
KeyError: "['Bugünkü Test Sayısı'] not in index"
cowidev.testing.batch.north_korea ❌ 2022-06-23T12:38:12 45.68
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3361, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 76, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 108, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'Daily change in cumulative total'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/north_korea.py", line 49, in main
    NorthKorea().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/north_korea.py", line 44, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/north_korea.py", line 40, in pipeline
    df = df.pipe(self.pipe_rename_columns).pipe(self.pipe_filter).pipe(self.pipe_metadata)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/generic.py", line 5430, in pipe
    return com.pipe(self, func, *args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/common.py", line 471, in pipe
    return func(obj, *args, **kwargs)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/north_korea.py", line 34, in pipe_filter
    df["Daily change in cumulative total"] = pd.to_numeric(df["Daily change in cumulative total"])
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/frame.py", line 3458, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3363, in get_loc
    raise KeyError(key) from err
KeyError: 'Daily change in cumulative total'
cowidev.testing.batch.mexico ❌ 2022-06-23T12:37:27 0.67
show
Traceback (most recent call last):
  File "/Users/cam/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run
    module.main()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/mexico.py", line 74, in main
    Mexico().export()
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/mexico.py", line 69, in export
    df = self.read().pipe(self.pipeline)
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/mexico.py", line 26, in read
    self.url_melt(f"{base_url}Confirmados_{yesterday}.csv", "positive"),
  File "/Users/cam/covid-19-data/scripts/src/cowidev/testing/batch/mexico.py", line 15, in url_melt
    df_melt = pd.read_csv(url).melt(id_vars=["cve_ent", "poblacion", "nombre"], var_name="Date", value_name=name)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/util/_decorators.py", line 311, in wrapper
    return func(*args, **kwargs)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 482, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 811, in __init__
    self._engine = self._make_engine(self.engine)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine
    return mapping[engine](self.f, **self.options)  # type: ignore[call-arg]
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 51, in __init__
    self._open_handles(src, kwds)
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/parsers/base_parser.py", line 222, in _open_handles
    self.handles = get_handle(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 609, in get_handle
    ioargs = _get_filepath_or_buffer(
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 312, in _get_filepath_or_buffer
    with urlopen(req_info) as req:
  File "/Users/cam/covid-19-data/venv/lib/python3.10/site-packages/pandas/io/common.py", line 212, in urlopen
    return urllib.request.urlopen(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
cowidev.testing.incremental.ukraine ⚠️ 2022-06-23T12:35:50 NaN
cowidev.testing.incremental.vanuatu ⚠️ 2022-06-23T12:35:50 NaN
cowidev.testing.incremental.gibraltar ⚠️ 2022-06-23T12:35:28 NaN
cowidev.testing.incremental.benin ⚠️ 2022-06-23T12:35:20 NaN
cowidev.testing.batch.philippines ⚠️ 2022-06-23T12:35:04 NaN
cowidev.testing.batch.kazakhstan ⚠️ 2022-06-23T12:35:00 NaN
cowidev.testing.batch.indonesia ⚠️ 2022-06-23T12:34:59 NaN
cowidev.testing.batch.guatemala ⚠️ 2022-06-23T12:34:58 NaN
cowidev.testing.batch.andorra ⚠️ 2022-06-23T12:34:54 NaN
cowidev.testing.batch.australia ✅ 2022-08-10T14:33:15 0.30
cowidev.testing.batch.liechtenstein ✅ 2022-06-23T12:37:24 144.54
cowidev.testing.incremental.kosovo ✅ 2022-06-23T12:36:00 26.83
cowidev.testing.incremental.vietnam ✅ 2022-06-23T12:35:53 3.34
cowidev.testing.incremental.timor ✅ 2022-06-23T12:35:51 2.53
cowidev.testing.incremental.tunisia ✅ 2022-06-23T12:35:51 2.46
cowidev.testing.incremental.myanmar ✅ 2022-06-23T12:35:50 12.59
cowidev.testing.incremental.togo ✅ 2022-06-23T12:35:50 1.75
cowidev.testing.incremental.saint_vincent_and_the_grenadines ✅ 2022-06-23T12:35:49 2.58
cowidev.testing.incremental.singapore ✅ 2022-06-23T12:35:49 1.69
cowidev.testing.incremental.suriname ✅ 2022-06-23T12:35:48 1.24
cowidev.testing.incremental.sweden ✅ 2022-06-23T12:35:48 1.21
cowidev.testing.incremental.nepal ✅ 2022-06-23T12:35:47 8.91
cowidev.testing.incremental.pakistan ✅ 2022-06-23T12:35:47 5.08
cowidev.testing.incremental.saint_lucia ✅ 2022-06-23T12:35:47 1.09
cowidev.testing.incremental.paraguay ✅ 2022-06-23T12:35:46 2.10
cowidev.testing.incremental.saint_kitts_nevis ✅ 2022-06-23T12:35:46 0.70
cowidev.testing.incremental.nicaragua ✅ 2022-06-23T12:35:45 6.82
cowidev.testing.incremental.palau ✅ 2022-06-23T12:35:45 2.97
cowidev.testing.incremental.new_zealand ✅ 2022-06-23T12:35:42 3.55
cowidev.testing.incremental.north_macedonia ✅ 2022-06-23T12:35:42 3.48
cowidev.testing.incremental.morocco ✅ 2022-06-23T12:35:39 1.19
cowidev.testing.incremental.laos ✅ 2022-06-23T12:35:38 5.38
cowidev.testing.incremental.lebanon ✅ 2022-06-23T12:35:38 4.88
cowidev.testing.incremental.libya ✅ 2022-06-23T12:35:37 3.95
cowidev.testing.incremental.maldives ✅ 2022-06-23T12:35:36 1.43
cowidev.testing.incremental.fiji ✅ 2022-06-23T12:35:34 6.73
cowidev.testing.incremental.cape_verde ✅ 2022-06-23T12:35:33 11.84
cowidev.testing.incremental.haiti ✅ 2022-06-23T12:35:33 4.42
cowidev.testing.incremental.iran ✅ 2022-06-23T12:35:33 4.26
cowidev.testing.incremental.greece ✅ 2022-06-23T12:35:32 3.58
cowidev.testing.incremental.bahamas ✅ 2022-06-23T12:35:28 9.52
cowidev.testing.incremental.croatia ✅ 2022-06-23T12:35:28 6.66
cowidev.testing.incremental.faeroe_islands ✅ 2022-06-23T12:35:28 1.64
cowidev.testing.incremental.equatorial_guinea ✅ 2022-06-23T12:35:27 3.76
cowidev.testing.incremental.el_salvador ✅ 2022-06-23T12:35:23 1.22
cowidev.testing.incremental.belize ✅ 2022-06-23T12:35:22 2.47
cowidev.testing.batch.ecdc ✅ 2022-06-23T12:35:21 25.16
cowidev.testing.incremental.bulgaria ✅ 2022-06-23T12:35:21 1.19
cowidev.testing.incremental.antigua_barbuda ✅ 2022-06-23T12:35:20 3.64
cowidev.testing.incremental.bahrain ✅ 2022-06-23T12:35:20 1.59
cowidev.testing.incremental.bangladesh ✅ 2022-06-23T12:35:20 1.47
cowidev.testing.batch.united_states_virgin_islands ✅ 2022-06-23T12:35:18 4.09
cowidev.testing.batch.united_states ✅ 2022-06-23T12:35:18 4.06
cowidev.testing.incremental.albania ✅ 2022-06-23T12:35:18 2.72
cowidev.testing.incremental.azerbaijan ✅ 2022-06-23T12:35:18 1.93
cowidev.testing.batch.united_arab_emirates ✅ 2022-06-23T12:35:16 2.85
cowidev.testing.batch.united_kingdom ✅ 2022-06-23T12:35:16 2.22
cowidev.testing.incremental.africacdc ✅ 2022-06-23T12:35:16 0.90
cowidev.testing.batch.switzerland ✅ 2022-06-23T12:35:15 4.97
cowidev.testing.batch.zambia ✅ 2022-06-23T12:35:15 0.49
cowidev.testing.batch.uruguay ✅ 2022-06-23T12:35:15 0.32
cowidev.testing.batch.northern_mariana_islands ✅ 2022-06-23T12:35:14 12.22
cowidev.testing.batch.puerto_rico ✅ 2022-06-23T12:35:14 10.44
cowidev.testing.batch.thailand ✅ 2022-06-23T12:35:14 2.82
cowidev.testing.batch.trinidad_and_tobago ✅ 2022-06-23T12:35:13 0.57
cowidev.testing.batch.sri_lanka ✅ 2022-06-23T12:35:12 3.10
cowidev.testing.batch.taiwan ✅ 2022-06-23T12:35:12 1.76
cowidev.testing.batch.netherlands ✅ 2022-06-23T12:35:11 10.22
cowidev.testing.batch.south_korea ✅ 2022-06-23T12:35:10 1.97
cowidev.testing.batch.slovenia ✅ 2022-06-23T12:35:09 1.25
cowidev.testing.batch.senegal ✅ 2022-06-23T12:35:08 0.63
cowidev.testing.batch.serbia ✅ 2022-06-23T12:35:08 0.55
cowidev.testing.batch.slovakia ✅ 2022-06-23T12:35:08 0.49
cowidev.testing.batch.saudi_arabia ✅ 2022-06-23T12:35:08 0.46
cowidev.testing.batch.south_africa ✅ 2022-06-23T12:35:08 0.31
cowidev.testing.batch.marshall_islands ✅ 2022-06-23T12:35:07 6.63
cowidev.testing.batch.qatar ✅ 2022-06-23T12:35:07 3.31
cowidev.testing.batch.rwanda ✅ 2022-06-23T12:35:07 3.00
cowidev.testing.batch.guam ✅ 2022-06-23T12:35:04 6.33
cowidev.testing.batch.luxembourg ✅ 2022-06-23T12:35:04 3.73
cowidev.testing.batch.peru ✅ 2022-06-23T12:35:04 0.65
cowidev.testing.batch.portugal ✅ 2022-06-23T12:35:04 0.40
cowidev.testing.batch.norway ✅ 2022-06-23T12:35:03 1.14
cowidev.testing.batch.israel ✅ 2022-06-23T12:35:02 2.82
cowidev.testing.batch.colombia ✅ 2022-06-23T12:35:01 6.74
cowidev.testing.batch.hungary ✅ 2022-06-23T12:35:01 2.11
cowidev.testing.batch.latvia ✅ 2022-06-23T12:35:01 1.17
cowidev.testing.batch.lithuania ✅ 2022-06-23T12:35:01 0.84
cowidev.testing.batch.malaysia ✅ 2022-06-23T12:35:01 0.25
cowidev.testing.batch.malta ✅ 2022-06-23T12:35:01 0.24
cowidev.testing.batch.iceland ✅ 2022-06-23T12:35:00 1.07
cowidev.testing.batch.ireland ✅ 2022-06-23T12:35:00 0.76
cowidev.testing.batch.japan ✅ 2022-06-23T12:35:00 0.49
cowidev.testing.batch.italy ✅ 2022-06-23T12:35:00 0.29
cowidev.testing.batch.bosnia_herzegovina ✅ 2022-06-23T12:34:59 5.02
cowidev.testing.batch.estonia ✅ 2022-06-23T12:34:59 2.25
cowidev.testing.batch.france ✅ 2022-06-23T12:34:59 1.94
cowidev.testing.batch.finland ✅ 2022-06-23T12:34:59 1.57
cowidev.testing.batch.germany ✅ 2022-06-23T12:34:59 0.99
cowidev.testing.batch.india ✅ 2022-06-23T12:34:59 0.42
cowidev.testing.batch.cyprus ✅ 2022-06-23T12:34:58 3.29
cowidev.testing.batch.cuba ✅ 2022-06-23T12:34:58 2.82
cowidev.testing.batch.denmark ✅ 2022-06-23T12:34:58 2.75
cowidev.testing.batch.ecuador ✅ 2022-06-23T12:34:58 1.02
cowidev.testing.batch.argentina ✅ 2022-06-23T12:34:57 3.24
cowidev.testing.batch.austria ✅ 2022-06-23T12:34:57 3.22
cowidev.testing.batch.czechia ✅ 2022-06-23T12:34:57 1.80
cowidev.testing.batch.armenia ✅ 2022-06-23T12:34:56 1.97
cowidev.testing.batch.belgium ✅ 2022-06-23T12:34:55 1.60
cowidev.testing.batch.brazil ✅ 2022-06-23T12:34:55 0.85
cowidev.testing.batch.chile ✅ 2022-06-23T12:34:55 0.63
cowidev.testing.batch.bolivia ✅ 2022-06-23T12:34:54 0.36