Commit graph

291 commits

Author SHA1 Message Date
GitHub Actions
c563038720 chore: scheduled poetry update 2023-12-17 20:22:12 +00:00
GitHub Actions
6e9d527359 chore: scheduled poetry update 2023-12-10 20:22:05 +00:00
GitHub Actions
f42db328f1 chore: scheduled poetry update 2023-12-03 20:22:18 +00:00
GitHub Actions
4915cc80c2 chore: scheduled poetry update 2023-11-26 20:22:06 +00:00
GitHub Actions
a995babb62 chore: scheduled poetry update 2023-11-19 20:22:12 +00:00
Rohan McGovern
e5543a3454 [ci] fix install of OS packages in CI workflows
We should be using "apt-get update" to update package lists before
installing any new packages. This has never mattered before, but
recently the installation of various packages started to fail with
404 errors, which are resolved by updating the package lists first.
2023-11-14 08:53:44 +10:00
GitHub Actions
3656a95797 chore: scheduled poetry update 2023-11-12 20:21:42 +00:00
github-actions[bot]
8b101d10fe
Merge pull request #74 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-11-07 20:22:43 +00:00
GitHub Actions
6483f999a3 chore: scheduled poetry update 2023-11-05 20:21:56 +00:00
github-actions[bot]
a92e98a91a
Merge pull request #73 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-31 20:22:33 +00:00
GitHub Actions
e92ca49981 chore: scheduled poetry update 2023-10-29 20:21:53 +00:00
github-actions[bot]
b750a76abe
Merge pull request #72 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-24 20:22:43 +00:00
GitHub Actions
274798c59b chore: scheduled poetry update 2023-10-22 20:21:42 +00:00
github-actions[bot]
53dff02b50
Merge pull request #71 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-17 20:22:50 +00:00
GitHub Actions
0e027fc68c chore: scheduled poetry update 2023-10-15 20:21:47 +00:00
github-actions[bot]
89b6b3d22c
Merge pull request #70 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-10 20:21:19 +00:00
GitHub Actions
8ac11c1337 chore: scheduled poetry update 2023-10-08 20:21:52 +00:00
github-actions[bot]
b404ef475c
Merge pull request #69 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-03 20:21:58 +00:00
GitHub Actions
2a1426510e chore: scheduled poetry update 2023-10-01 20:21:40 +00:00
github-actions[bot]
eb5a588e43
Merge pull request #68 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-26 20:22:44 +00:00
GitHub Actions
b7a773d667 chore: scheduled poetry update 2023-09-24 20:21:46 +00:00
Rohan McGovern
ad1fee0f41
Merge pull request #67 from rohanpm/mem-usage-stream
Further reduce memory usage on large yum repos [RHELDST-20453]
2023-09-22 07:26:59 +10:00
Rohan McGovern
eac74ec1e4 Further reduce memory usage on large yum repos [RHELDST-20453]
The Fetcher type was designed to return a 'str'.
That wasn't a good idea because it implies that every fetched file must
be loaded into memory completely. On certain large yum repos,
decompressed primary XML can be hundreds of MB, and it's not appropriate
to require loading that all into memory at once.

Make it support a file-like object (stream of bytes). Since the SAX
XML parser supports reading from a stream, this makes it possible to
avoid loading everything into memory at once.

A test of repo-autoindex CLI against
/content/dist/rhel/server/7/7Server/x86_64/os showed major
improvement:

- before: ~1200MiB
- after:    ~80MiB

Note that achieving the full improvement requires any downstream users
of the library (e.g. exodus-gw) to update their Fetcher implementation
as well, to stop returning a 'str'.
2023-09-21 11:05:21 +10:00
github-actions[bot]
02501a7b36
Merge pull request #65 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-19 20:22:40 +00:00
Rohan McGovern
c557a61876
Merge pull request #66 from rohanpm/add-py.typed
Add py.typed for PEP 561
2023-09-19 07:31:33 +10:00
Rohan McGovern
efb595d624 Add py.typed for PEP 561
This library includes inline type hints, but per PEP 561 this must be
indicated by including a "py.typed" marker file, otherwise tools like
mypy will not make use of the type hints when checking downstream
projects.
2023-09-18 13:28:02 +10:00
GitHub Actions
e3ba70a530 chore: scheduled poetry update 2023-09-17 20:21:36 +00:00
github-actions[bot]
2456127e36
Merge pull request #64 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-12 20:22:34 +00:00
GitHub Actions
f88a906f2b chore: scheduled poetry update 2023-09-10 20:21:30 +00:00
github-actions[bot]
090d4b1442
Merge pull request #63 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-05 20:21:46 +00:00
GitHub Actions
79f3203441 chore: scheduled poetry update 2023-09-03 20:21:30 +00:00
github-actions[bot]
a701f6accc
Merge pull request #62 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-08-22 20:22:17 +00:00
GitHub Actions
bfdadfe53f chore: scheduled poetry update 2023-08-20 20:21:05 +00:00
github-actions[bot]
6064a8e8fd
Merge pull request #61 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-08-15 20:22:09 +00:00
GitHub Actions
f4eae98e91 chore: scheduled poetry update 2023-08-13 20:21:14 +00:00
github-actions[bot]
516dc5140a
Merge pull request #60 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-08-08 20:22:36 +00:00
GitHub Actions
0c963d3cc3 chore: scheduled poetry update 2023-08-06 20:21:13 +00:00
github-actions[bot]
865451d32f
Merge pull request #59 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-08-01 20:22:23 +00:00
GitHub Actions
5bf42111ab chore: scheduled poetry update 2023-07-30 20:21:25 +00:00
github-actions[bot]
85abb7ffb5
Merge pull request #58 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-07-25 20:22:07 +00:00
GitHub Actions
d5eab6a5f8 chore: scheduled poetry update 2023-07-23 20:21:52 +00:00
github-actions[bot]
ccc63f8bce
Merge pull request #57 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-07-18 20:23:15 +00:00
GitHub Actions
a058b5ae62 chore: scheduled poetry update 2023-07-16 20:23:12 +00:00
github-actions[bot]
6cd49e7ea7
Merge pull request #56 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-07-11 20:23:55 +00:00
GitHub Actions
4c49a62961 chore: scheduled poetry update 2023-07-09 20:23:11 +00:00
github-actions[bot]
6afd5409fd
Merge pull request #55 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-07-04 20:24:28 +00:00
GitHub Actions
a7204df4cc chore: scheduled poetry update 2023-07-02 20:23:03 +00:00
github-actions[bot]
c6411babe8
Merge pull request #54 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-06-27 20:24:09 +00:00
GitHub Actions
9c37bdf24a chore: scheduled poetry update 2023-06-25 20:23:48 +00:00
github-actions[bot]
031ed5a98c
Merge pull request #53 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-06-20 20:21:51 +00:00