Analytics Vidhya

DECEMBER 20, 2022

Introduction Source: krzysztof-m from Pixabay Amazon Web Services (AWS) Simple Storage Service (S3) is a highly scalable, secure, and durable cloud storage service. The post How to Optimize the Performance of AWS S3? appeared first on Analytics Vidhya.

AWS 242

AWS Data Science Analytics Analytics 242

Hacker News

APRIL 18, 2024

Supabase Storage is now officially an S3-Compatible Storage Provider.

180

180

Analytics Vidhya

SEPTEMBER 20, 2022

The post How do AWS S3 Buckets and Security Work? appeared first on Analytics Vidhya.

AWS 261

AWS Machine Learning Machine Learning Data Science 261

AWS Machine Learning Blog

MARCH 13, 2024

Typically, these datasets are aggregated in a centralized Amazon Simple Storage Service (Amazon S3) location from various business applications and enterprise systems. Amazon S3 Access Points simplify managing and securing data access at scale for applications using shared datasets on Amazon S3.

AWS 90

AWS Data Scientist Artificial Intelligence Artificial Intelligence 90

Hacker News

DECEMBER 16, 2023

AWS just announced a new lower-latency S3 storage class and for those of us in the data infrastructure business, this is big news. So has this new world arrived with S3 Express One Zone? It’s not a secret that a low-latency object storage primitive has the potential to change how we build cloud data systems forever.

Cloud Data 152

Cloud Data AWS 152

Hacker News

FEBRUARY 13, 2024

How I switched my side project from using Amazon S3 for file hosting to using Tigris (which is built on Fly.io infrastructure). It was a good experience overall, but there were a few quirks.

117

117

Hacker News

DECEMBER 23, 2023

Fastest golang in-memory cache library based on S3-FIFO algorithm. many times faster than Ristretto and friends - GitHub - maypok86/otter: Fastest golang in-memory cache library based on S3-FIFO algorithm. many times faster than Ristretto and friends

Algorithm 122

Algorithm 122

Hacker News

FEBRUARY 26, 2024

A technique to find the Account ID of a private S3 bucket.

AWS 181

AWS 181

Hacker News

JUNE 9, 2023

We wanted to share the latest updates and highlights of the recent S3 Community Call. We discussed our next steps as LogicBlox, the longstanding sponsor of [link] is ending its sponsorship.

122

122

Hacker News

JUNE 2, 2023

Hi all, TL;DR - Kicking off an effort to secure long-term funding for our S3 costs and exploring alternatives. This comes after multiple years where Logicblox has been graciously sponsoring the S3 costs for Nix! An enormous thank you to them.

123

123

Hacker News

JULY 27, 2023

Three distinct perspectives on scale that come along with building and operating a storage system the size of S3.

123

123

Hacker News

JULY 2, 2023

Based on a Sochip S3 SoC, featuring a Webinterface, shairport-sync, snapcast, Spotify Connect and pulseaudio sink/source. Based on a Sochip S3 SoC, featuring a Webinterface, shairport-sync, snapcast, Spotify Connect and pulseaudio sink/source. OtterCast is an open-source audio streaming device running Linux.

94

94

AWS Machine Learning Blog

MARCH 2, 2023

The Amazon Kendra’s S3 connector supports indexing documents and their associated metadata stored in an S3 bucket. It’s often the case that you want to make sure that applications running inside a VPC have access only to specific S3 buckets and in many cases the connection must not traverse the internet to reach public endpoints.

AWS 86

AWS Database Machine Learning Machine Learning 86

Hacker News

MAY 5, 2024

Comments (..)

141

141

Mlearning.ai

MARCH 1, 2023

In this article, we will discover how to build an ETL pipeline by consuming data from S3 to AWS Redshift via the Glue service and… Continue reading on MLearning.ai »

AWS 52

AWS ETL ML ML 52

phData

APRIL 4, 2023

Today we want to introduce Fivetran’s support for Amazon S3 with Apache Iceberg, investigate some of the implications of this feature, and learn how it fits into the modern data architecture as a whole. Fivetran today announced support for Amazon Simple Storage Service (Amazon S3) with Apache Iceberg data lake format.

Data Lakes 52

Data Lakes Data Warehouse Cloud Data AWS 52

Hacker News

MARCH 9, 2024

Comments (..)

181

181

Hacker News

MAY 13, 2024

Comments (..)

140

140

Analytics Vidhya

MARCH 5, 2023

Introduction Amazon Athena is an interactive query tool supplied by Amazon Web Services (AWS) that allows you to use conventional SQL queries to evaluate data stored in Amazon S3. Athena is a serverless service. Thus there are no servers to operate, and you pay for the queries you perform.

SQL 292

SQL AWS Analytics Analytics 292

Hacker News

MAY 1, 2024

Comments (..)

103

103

Hacker News

JUNE 19, 2023

Understanding our data and usage patterns was the real key.

132

132

Hacker News

NOVEMBER 28, 2023

Comments (..)

139

139

Hacker News

FEBRUARY 2, 2024

Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Data Lakes 129

Data Lakes Hadoop 129

Hacker News

NOVEMBER 14, 2023

I recently blogged about why I believe the future of cloud data services is large-scale and multi-tenant, citing, among others, S3. “Top Top tier SaaS services like S3 are able to deliver amazing simplicity, reliability, durability, scalability, and low price because their technologies are structurally oriented to deliver those things.

Data Warehouse 181

Data Warehouse Cloud Data Database 181

Analytics Vidhya

JULY 14, 2023

Introduction When we start learning AWS, we usually learn bits and pieces of it, like some of the core services; working around the AWS console, we could create a new ec2 instance or an s3 bucket and upload something to it. But in most cases, we couldn’t put all the services together into an actual application.

AWS 262

AWS Analytics Analytics Database 262

Hacker News

MAY 4, 2023

Comments (..)

94

94

Analytics Vidhya

JANUARY 2, 2023

Delta Lakes provides an ACID transaction–compliant and cloud–native platform on top of cloud object stores such as Amazon S3, Microsoft Azure Storage, and Google Cloud Storage. Introduction Delta Lake is an open-source storage layer that brings data lakes to the world of Apache Spark.

Data Lakes 309

Data Lakes Azure Analytics Analytics 309

Hacker News

DECEMBER 1, 2023

I've finished testing the latest boards from [link] One of the problems I found was a conflict with the pins I'd used for the S.

132

132

Towards AI

APRIL 3, 2024

Athena works with the data stored in S3. We know the data stored in S3 is very cheap and they are highly available. Another thing to note in Athena is we need to specify the output S3 location where the output of the query would get stored. First things first, load the sample data into the S3 bucket.

AWS 98

AWS Database ETL AI 98

insideBIGDATA

JUNE 9, 2023

The company’s cloud-native solution operationalizes a next-generation approach to AI efficiency via data reduction and data privacy, enabling AI teams using Amazon S3 and Google Cloud Storage (GCS) to derive maximum value from their ever-growing volumes of training data.

Cloud Data 195

Cloud Data AI AI Deep Learning 195

Hacker News

MARCH 26, 2023

Comments (..)

AWS 154

AWS 154

Hacker News

AUGUST 8, 2023

The T-Watch S3 from LILYGO is an open-source device built around the ESP32-S3 SoC with Wi-Fi and BLE connectivity. The device also includes an 1.54” LCD display with capacitive touch capabilities and Arduino support.

123

123

Analytics Vidhya

JULY 23, 2022

Introduction Amazon Athena is an interactive query service based on open-source Apache Presto that allows you to analyze data stored in Amazon S3 using ANSI SQL directly. This article was published as a part of the Data Science Blogathon. In addition, it is serverless, so there is no infrastructure to manage and maintain, and you […].

AWS 304

AWS Database SQL Data Science 304

Towards AI

APRIL 10, 2024

I’ll explain the steps to configure Amazon S3 bucket to store the artifacts, Amazon RDS (Postgres & Mysql) to store metadata, and EC2 instance to host the mlflow server. Create S3 Bucket In my previous blog, I explained the way to create S3 Bucket. Let’s dive into setting up an MLflow Server on an EC2 instance!

Database 119

Database Machine Learning Machine Learning AWS 119

Hacker News

JANUARY 26, 2024

Rclone syncs your files to cloud storage: Google Drive, S3, Swift, Dropbox, Google Cloud Storage, Azure, Box and many more.

Azure 130

Azure 130

AWS Machine Learning Blog

APRIL 5, 2024

Amazon Rekognition includes a simple, easy-to-use API that can quickly analyze any image or video file that’s stored in Amazon Simple Storage Service (Amazon S3). Enter a job name and specify the images to analyze, either by entering an S3 bucket location or by uploading images from your computer. region_name s3=boto3.client('s3')

AWS 106

AWS Machine Learning Machine Learning Deep Learning 106

AWS Machine Learning Blog

MARCH 25, 2024

In batch transcription mode, an audio file first needs to be put in an Amazon Simple Storage Service (Amazon S3) bucket. Then a batch transcription job referencing the S3 URI of this file is created in Amazon Transcribe. Both Amazon Transcribe in batch mode and Amazon S3 use HTTP/1.1 over TLS to protect data in transit.

AWS 82

AWS Natural Language Processing Machine Learning Machine Learning 82