finally, an AWS supported native S3 client that mounts directly to file system (OK so non posix), my workflow needs to read hundreds to thousands of files (approximately 300-500MB a piece) for processing (TEM micrograph data). I was able to launch 16 ec2 instances to read these puppies at 4000 files per hour. While each instance for processing these files is limited to 10-50Gbps, launching several of these instances taking advantage of S3's high throughput, made the process so much easier.
Hi there. These two docs can help explain the differences: go.aws/45hrZ3c & go.aws/3YB49xh. I also suggest asking our community of experts and devs, in re:Post, for further use cases: go.aws/aws-repost. ^RS
Can we also mount a s3 bucket on eks cluster . I exec and after running the command getting "mount-s3 mybucket /tests3" I'm getting below error fuse: device not found, try 'modprobe fuse' first Error: Failed to create FUSE session Caused by: No such file or directory (os error 2) Error: Failed to create mount process
I understand your concern, Sachin. For a closer look into this, consider opening a support case or reaching out via re:Post as mentioned in this article: go.aws/tech-support. ^ES
finally, an AWS supported native S3 client that mounts directly to file system (OK so non posix), my workflow needs to read hundreds to thousands of files (approximately 300-500MB a piece) for processing (TEM micrograph data). I was able to launch 16 ec2 instances to read these puppies at 4000 files per hour. While each instance for processing these files is limited to 10-50Gbps, launching several of these instances taking advantage of S3's high throughput, made the process so much easier.
Well this greatly simplifies things. I still have a number of windows workloads but I can work around that for sure!
have just tried this one. amazed how simple it was. that's awesome! have to redesign the architecture of my application
That's AMAZING!!! 🤩 Thanks so much for the feedback! ❤️
Hello, What are the differences between this and s3fs? Thanks.
Hello! 👋 For the best assistance with your question, kindly reach out to our re:Post community of experts, here: go.aws/aws-repost. ^RZ
I just heard about this on LinkedIn, so could understand to a large extent but I would love to know more about use cases.
whats the difference between efs mount point and this s3 mountpoint, Can i diff with use case
Hi there. These two docs can help explain the differences: go.aws/45hrZ3c & go.aws/3YB49xh. I also suggest asking our community of experts and devs, in re:Post, for further use cases: go.aws/aws-repost.
^RS
Can we also mount a s3 bucket on eks cluster . I exec and after running the command getting "mount-s3 mybucket /tests3" I'm getting below error
fuse: device not found, try 'modprobe fuse' first
Error: Failed to create FUSE session
Caused by:
No such file or directory (os error 2)
Error: Failed to create mount process
I understand your concern, Sachin. For a closer look into this, consider opening a support case or reaching out via re:Post as mentioned in this article: go.aws/tech-support. ^ES