feat: Add CLPRemoteHandler to handle Multipart Upload to AWS S3 bucket - #50

Open

IreneLime wants to merge 31 commits into

y-scope:mainfrom

IreneLime:remote-handler

Commits on Jan 3, 2025

Create class CLPRemoteHandler
IreneLime
committed
7bc1e8a
Create multipart upload initiation
IreneLime
committed
0ae4a2a
Create function that performs multipart upload on 5mb segments
IreneLime
committed
8895b37
Create function that completes multipart upload
IreneLime
committed
7475ed5
Handle corner case: file rotation when part number exceeds 10000
IreneLime
committed
96a831b
Integrate timeout functionalities for CLPLogLevelTimeout usage and close for CLPFileHandler usage
IreneLime
committed
055eaf0
Avoid new upload initialization when previous upload has not completed
IreneLime
committed
b32b5f2
Ensure consistent string quotation
IreneLime
committed
ed3a57b

Commits on Jan 5, 2025

Remove print statements and fix aws segment limitation error
IreneLime
committed
964ae20
Modify code to pass typing tests.
IreneLime
committed
1fa0163
Code format & linting test
IreneLime
committed
85cac30

Commits on Feb 9, 2025

Redesign CLPS3Handler architecture and complete a functional draft of the handler
IreneLime
committed
065c28c

Commits on Mar 17, 2025

Add aws credential configuration
IreneLime
committed
828897e
Add rotation after 10000 parts
IreneLime
committed
2267849

Commits on Mar 18, 2025

Fix part limit rotation
IreneLime
committed
ba5c3dd
Fix aws credential checking
IreneLime
committed
a9ec06d
Enable sha256 checksum on multipart upload
IreneLime
committed
0aef71d
Add error checking throughout the upload process
IreneLime
committed
4839528

Commits on Mar 21, 2025

Commits on Mar 25, 2025

Commits on Mar 26, 2025

Add comments to explain parameters
IreneLime
committed
238d625
Maintain consistent naming in S3 handler
IreneLime
committed
2c0a34a
Fix object key naming issue
IreneLime
committed
b448143