Commit graph

209 commits

Author SHA1 Message Date
github-actions[bot]
5f44f4b0f4
Merge pull request #79 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2024-02-13 20:23:31 +00:00
GitHub Actions
b8107ec92c chore: scheduled poetry update 2024-02-11 20:22:18 +00:00
GitHub Actions
746c9471c6 chore: scheduled poetry update 2024-02-04 20:21:34 +00:00
GitHub Actions
f2d23b1690 chore: scheduled poetry update 2024-01-28 20:21:08 +00:00
github-actions[bot]
3ff2544eb1
Merge pull request #78 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2024-01-23 20:23:34 +00:00
GitHub Actions
74e0ae2cdb chore: scheduled poetry update 2024-01-21 20:22:37 +00:00
GitHub Actions
7b6cc5ccc1 Merge remote-tracking branch 'origin/main' into deps/poetry-update 2024-01-21 20:22:16 +00:00
Rohan McGovern
c60b63996c Release 1.2.1 2024-01-15 08:07:02 +10:00
Rohan McGovern
5dacb650ae
Merge pull request #77 from rohanpm/sort-listings
Ensure directories appear first in listings [RHELDST-21890]
2024-01-15 08:05:54 +10:00
GitHub Actions
3ec56c5701 chore: scheduled poetry update 2024-01-14 20:22:27 +00:00
GitHub Actions
32613d7c2b Merge remote-tracking branch 'origin/main' into deps/poetry-update 2024-01-14 20:22:07 +00:00
Rohan McGovern
97a28fb7b1 Ensure directories appear first in listings [RHELDST-21890]
Directories are generally expected to be listed first in directory
indexes. That was already working for yum and file repos, but wasn't the
case for kickstart repos due to their combination of different types of
content.

This commit applies a consistent sorting so that directories will always
come first, and entries will otherwise be sorted by name, for all repo
types.
2024-01-12 08:48:42 +10:00
Rohan McGovern
137388d475 Avoid spurious mypy failure in latest xml type hints
startElement signature changed in the .pyi stubs for XML classes,
triggering a mypy complaint here. Suppress it as there is no actual
error here.
2024-01-12 08:48:42 +10:00
Rohan McGovern
a015ae58d0 chore: scheduled poetry update 2024-01-12 08:48:35 +10:00
Rohan McGovern
ee42465b82
Merge pull request #76 from rohanpm/ci-apt-get-fix
[ci] fix install of OS packages in CI workflows
2024-01-12 08:37:48 +10:00
GitHub Actions
4f257d6cc4 chore: scheduled poetry update 2024-01-07 20:22:15 +00:00
GitHub Actions
71e8e1bbcc chore: scheduled poetry update 2023-12-31 20:22:13 +00:00
GitHub Actions
9f70b4cbd8 chore: scheduled poetry update 2023-12-24 20:22:06 +00:00
GitHub Actions
c563038720 chore: scheduled poetry update 2023-12-17 20:22:12 +00:00
GitHub Actions
6e9d527359 chore: scheduled poetry update 2023-12-10 20:22:05 +00:00
GitHub Actions
f42db328f1 chore: scheduled poetry update 2023-12-03 20:22:18 +00:00
GitHub Actions
4915cc80c2 chore: scheduled poetry update 2023-11-26 20:22:06 +00:00
GitHub Actions
a995babb62 chore: scheduled poetry update 2023-11-19 20:22:12 +00:00
Rohan McGovern
e5543a3454 [ci] fix install of OS packages in CI workflows
We should be using "apt-get update" to update package lists before
installing any new packages. This has never mattered before, but
recently the installation of various packages started to fail with
404 errors, which are resolved by updating the package lists first.
2023-11-14 08:53:44 +10:00
GitHub Actions
3656a95797 chore: scheduled poetry update 2023-11-12 20:21:42 +00:00
github-actions[bot]
8b101d10fe
Merge pull request #74 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-11-07 20:22:43 +00:00
GitHub Actions
6483f999a3 chore: scheduled poetry update 2023-11-05 20:21:56 +00:00
github-actions[bot]
a92e98a91a
Merge pull request #73 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-31 20:22:33 +00:00
GitHub Actions
e92ca49981 chore: scheduled poetry update 2023-10-29 20:21:53 +00:00
github-actions[bot]
b750a76abe
Merge pull request #72 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-24 20:22:43 +00:00
GitHub Actions
274798c59b chore: scheduled poetry update 2023-10-22 20:21:42 +00:00
github-actions[bot]
53dff02b50
Merge pull request #71 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-17 20:22:50 +00:00
GitHub Actions
0e027fc68c chore: scheduled poetry update 2023-10-15 20:21:47 +00:00
github-actions[bot]
89b6b3d22c
Merge pull request #70 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-10 20:21:19 +00:00
GitHub Actions
8ac11c1337 chore: scheduled poetry update 2023-10-08 20:21:52 +00:00
github-actions[bot]
b404ef475c
Merge pull request #69 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-10-03 20:21:58 +00:00
GitHub Actions
2a1426510e chore: scheduled poetry update 2023-10-01 20:21:40 +00:00
github-actions[bot]
eb5a588e43
Merge pull request #68 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-26 20:22:44 +00:00
GitHub Actions
b7a773d667 chore: scheduled poetry update 2023-09-24 20:21:46 +00:00
Rohan McGovern
ad1fee0f41
Merge pull request #67 from rohanpm/mem-usage-stream
Further reduce memory usage on large yum repos [RHELDST-20453]
2023-09-22 07:26:59 +10:00
Rohan McGovern
eac74ec1e4 Further reduce memory usage on large yum repos [RHELDST-20453]
The Fetcher type was designed to return a 'str'.
That wasn't a good idea because it implies that every fetched file must
be loaded into memory completely. On certain large yum repos,
decompressed primary XML can be hundreds of MB, and it's not appropriate
to require loading that all into memory at once.

Make it support a file-like object (stream of bytes). Since the SAX
XML parser supports reading from a stream, this makes it possible to
avoid loading everything into memory at once.

A test of repo-autoindex CLI against
/content/dist/rhel/server/7/7Server/x86_64/os showed major
improvement:

- before: ~1200MiB
- after:    ~80MiB

Note that achieving the full improvement requires any downstream users
of the library (e.g. exodus-gw) to update their Fetcher implementation
as well, to stop returning a 'str'.
2023-09-21 11:05:21 +10:00
github-actions[bot]
02501a7b36
Merge pull request #65 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-19 20:22:40 +00:00
Rohan McGovern
c557a61876
Merge pull request #66 from rohanpm/add-py.typed
Add py.typed for PEP 561
2023-09-19 07:31:33 +10:00
Rohan McGovern
efb595d624 Add py.typed for PEP 561
This library includes inline type hints, but per PEP 561 this must be
indicated by including a "py.typed" marker file, otherwise tools like
mypy will not make use of the type hints when checking downstream
projects.
2023-09-18 13:28:02 +10:00
GitHub Actions
e3ba70a530 chore: scheduled poetry update 2023-09-17 20:21:36 +00:00
github-actions[bot]
2456127e36
Merge pull request #64 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-12 20:22:34 +00:00
GitHub Actions
f88a906f2b chore: scheduled poetry update 2023-09-10 20:21:30 +00:00
github-actions[bot]
090d4b1442
Merge pull request #63 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-09-05 20:21:46 +00:00
GitHub Actions
79f3203441 chore: scheduled poetry update 2023-09-03 20:21:30 +00:00
github-actions[bot]
a701f6accc
Merge pull request #62 from release-engineering/deps/poetry-update
chore: scheduled poetry update
2023-08-22 20:22:17 +00:00