Commit Graph

32 Commits

Author SHA1 Message Date
LawyZheng
0c3b5488cc fix sequential run issue (#3643) 2025-10-08 15:57:01 +08:00
Shuchang Zheng
4a787de5ef unthaw S3 objects (#3406) 2025-09-10 12:51:10 -07:00
LawyZheng
275426eb33 downloaded file debugger accessible (#3338) 2025-09-02 15:43:07 +08:00
Shuchang Zheng
fe9d017e76 add ec2 to aws client (#2919) 2025-07-10 01:22:27 -07:00
Shuchang Zheng
abfdf8964a add enableExecuteCommand option to the run_task function (#2918) 2025-07-09 18:07:51 -07:00
Shuchang Zheng
1d7585b40a update run_task to make it possible to expose ecs task publicly (#2916) 2025-07-09 16:32:46 -07:00
Asher Foa
d3079eaa4a add str method to S3Uri (#2703) 2025-06-13 06:43:42 -04:00
Asher Foa
e1d42afca9 Add boto3 docs links (#2682) 2025-06-13 09:40:32 +00:00
Asher Foa
47cf755d9c Add & use tag_set_to_dict (#2700) 2025-06-12 21:41:48 -04:00
Asher Foa
fcbc0672b3 add get_object_info to return a given object metadata (#2678) 2025-06-12 13:50:16 -04:00
Asher Foa
3100ff9543 Add the ability to add tags to s3 objects we upload + more tests for artifact upload (#2684) 2025-06-11 19:52:25 +00:00
Asher Foa
c1e19d27d3 basic test for s3 artifact upload logic (#2681) 2025-06-11 14:23:58 -04:00
Asher Foa
87fb5b4408 DRY getting boto3 clients (#2622) 2025-06-11 11:59:58 -04:00
Asher Foa
7b27ac9bdf There is no need to keep aws creds around, passing them down to boto.session is more than enough (#2625) 2025-06-10 15:17:22 -04:00
Asher Foa
effd0c4911 Add pyupgrade pre-commit hook + modernize python code (#2611) 2025-06-10 18:52:38 +00:00
Shuchang Zheng
3a927aa4e2 fix upload file storage class input style (#2618) 2025-06-06 01:36:46 -07:00
Asher Foa
990b1c921f Add support for s3 storage classes + added logging when we upload to s3 (#2610) 2025-06-05 18:26:52 -04:00
Shuchang Zheng
28b1ff4872 remove dead code in aws.py - execute_with_async_client (#2287) 2025-05-05 00:41:48 -07:00
Shuchang Zheng
6d8a49d5b5 file upload block backend (#2000) 2025-03-23 15:37:20 -07:00
Shuchang Zheng
889c8f1963 aws_client ECS tasks (#1861) 2025-03-02 02:00:41 -05:00
Shuchang Zheng
995d9461b5 Add Checksums to downloaded files for Axis so they can validate it in the webhook (#1848) 2025-02-26 20:19:05 -05:00
Shuchang Zheng
4407c19417 Add credentials table, CRUD endpoints, and credential parameter (#1767)
Co-authored-by: Muhammed Salih Altun <muhammedsalihaltun@gmail.com>
2025-02-13 19:00:19 +03:00
Shuchang Zheng
c0c1f51a55 remove noisy debug log (#1512) 2025-01-07 09:36:32 -08:00
Shuchang Zheng
3835f3ce69 make upload file from path log a debug log (#1468) 2025-01-02 10:09:23 -08:00
Shuchang Zheng
7f6b2c0929 shu/removeSettingsManager.get_settings (#1305) 2024-12-02 15:01:22 -08:00
LawyZheng
87061f5bb6 upload all downloaded files when using s3 (#1289) 2024-11-29 16:05:44 +08:00
Kerem Yilmaz
21b9eea446 Implement upload_file endpoint (#547) 2024-07-03 17:54:31 -07:00
Shuchang Zheng
f2ceb9f88d make log_exception optional for s3 file download - there are expected cases when the file is not there and the function returns None (#511) 2024-06-25 10:21:28 -07:00
Kerem Yilmaz
20a86590dd Implement get_share_links (#302) 2024-05-13 00:03:31 -07:00
Shuchang Zheng
b6a85cf3a5 remove exc_info from LOG.exception (#246) 2024-04-30 00:27:32 -07:00
Kerem Yilmaz
3d1b146470 Implement DownloadToS3Block (#133) 2024-03-28 16:46:54 -07:00
Kerem Yilmaz
9eddb3d812 Move the code over from private repository (#3) 2024-03-01 10:09:30 -08:00