KDnuggets

SEPTEMBER 25, 2019

Today, as companies have finally come to understand the value that data science can bring, more and more emphasis is being placed on the implementation of data science in production systems.

Data Science 238

Data Science Data Engineering Data Engineering Data Engineer 238

Analytics Vidhya

JANUARY 15, 2023

Introduction to AWS AWS, or Amazon Web Services, is one of the world’s most widely used cloud service providers. AWS has many clusters of data centers in multiple countries across the globe. The post AWS Lambda Tutorial: Creating Your First Lambda Function appeared first on Analytics Vidhya.

AWS 343

AWS Clustering Analytics Analytics 343

Data Science Dojo

JULY 24, 2023

They allow data processing tasks to be distributed across multiple machines, enabling parallel processing and scalability. It involves various technologies and techniques that enable efficient data processing and retrieval. Stay tuned for an insightful exploration into the world of Big Data Engineering with Distributed Systems!

Big Data 195

Big Data Big Data Data Engineering Data Engineering 195

Analytics Vidhya

AUGUST 25, 2022

The post Using AWS Athena and QuickSight for Data Analysis appeared first on Analytics Vidhya. Also, have you ever tried doing this with Athena and QuickSight? This blog post will walk you through the necessary steps to achieve this using Amazon services and tools. Amazon’s perfect combination of […].

Data Analysis 378

Data Analysis Data Analysis AWS Data Science 378

Analytics Vidhya

SEPTEMBER 3, 2022

The post Elastic Load Balancer in AWS and its Benefits appeared first on Analytics Vidhya. The most important aspect of cloud computing is the on-demand application delivery paradigm from the cloud customer’s perspective. As a result, cloud services […].

AWS 357

AWS Cloud Computing Data Science Analytics 357

Analytics Vidhya

SEPTEMBER 3, 2022

The post AWS Elastic BeanStalk Processing and its Components appeared first on Analytics Vidhya. Introduction If you are a beginner or have little time, configuring the environment for your application may be too complicated and time-consuming. You need to consider monitoring, logs, security groups, VMs, backups, etc.

AWS 346

AWS Data Science Analytics Analytics 346

Analytics Vidhya

OCTOBER 17, 2022

Businesses of all sizes are switching to the cloud to manage risks, improve data security, streamline processes and decrease costs, or other reasons. The post AWS VPC: Creating Your own Virtual Private Network on Cloud appeared first on Analytics Vidhya. Many services are available from top cloud […].

AWS 370

AWS Cloud Computing Data Science Analytics 370

Analytics Vidhya

JANUARY 1, 2023

This article was published as a part of the Data Science Blogathon. convenient Introduction AWS Lambda is a serverless computing service that lets you run code in response to events while having the underlying compute resources managed for you automatically.

AWS 335

AWS Data Science Analytics Analytics 335

Analytics Vidhya

JANUARY 1, 2023

The post Introduction to Amazon API Gateway using AWS Lambda appeared first on Analytics Vidhya. If you want to make noodles, you just take the ingredients out of the cupboard, fire up the stove, and make it yourself. This […].

AWS 335

AWS Analytics Analytics Data Engineering 335

Analytics Vidhya

JULY 23, 2022

Introduction Amazon Athena is an interactive query service based on open-source Apache Presto that allows you to analyze data stored in Amazon S3 using ANSI SQL directly. The post How is AWS Athena Different from other Databases appeared first on Analytics Vidhya.

AWS 328

AWS Database SQL Data Science 328

Analytics Vidhya

NOVEMBER 16, 2022

Source: [link] Introduction Nowadays, a lot of data is being generated and consumed, resulting in a huge amount of internet traffic exponentially across the globe. The post AWS Route 53 – The Efficient DNS Solution appeared first on Analytics Vidhya.

AWS 302

AWS Data Science Analytics Analytics 302

Analytics Vidhya

JUNE 26, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Overview In this article, we will learn how to run/deploy containerized. The post Deploying Machine learning Application on AWS Fargate appeared first on Analytics Vidhya.

Machine Learning 298

Machine Learning Machine Learning AWS Data Science 298

AWS Machine Learning Blog

NOVEMBER 15, 2024

Principal wanted to use existing internal FAQs, documentation, and unstructured data and build an intelligent chatbot that could provide quick access to the right information for different roles. Principal also used the AWS open source repository Lex Web UI to build a frontend chat interface with Principal branding.

AWS 119

AWS AI AI Machine Learning 119

Analytics Vidhya

OCTOBER 4, 2022

It is a Lucene-based search engine developed in Java but supports clients in various languages ​​such as Python, C#, Ruby, and PHP. It takes unstructured data from multiple sources as input and stores it […]. The post Basic Concept and Backend of AWS Elasticsearch appeared first on Analytics Vidhya.

AWS 289

AWS Data Science Python Analytics 289

Flipboard

NOVEMBER 22, 2024

Solution overview The following diagram illustrates the ML platform reference architecture using various AWS services. The functional architecture with different capabilities is implemented using a number of AWS services, including AWS Organizations , Amazon SageMaker , AWS DevOps services, and a data lake.

Data Governance 132

Data Governance ML ML Data Lakes 132

Analytics Vidhya

APRIL 25, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon. Introduction Data Lake architecture for different use cases – Elegant. The post A Guide to Build your Data Lake in AWS appeared first on Analytics Vidhya.

Data Lakes 291

Data Lakes AWS Data Science Analytics 291

Data Science Connect

JANUARY 27, 2023

Data engineering is a crucial field that plays a vital role in the data pipeline of any organization. It is the process of collecting, storing, managing, and analyzing large amounts of data, and data engineers are responsible for designing and implementing the systems and infrastructure that make this possible.

Data Engineer 130

Data Engineer Data Engineering Data Engineering Data Engineering 130

Analytics Vidhya

AUGUST 3, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction Apache Spark is a framework used in cluster computing environments. The post Building a Data Pipeline with PySpark and AWS appeared first on Analytics Vidhya.

Data Pipeline 291

Data Pipeline AWS Clustering Data Science 291

AWS Machine Learning Blog

APRIL 3, 2025

At the heart of this transformation is the OMRON Data & Analytics Platform (ODAP), an innovative initiative designed to revolutionize how the company harnesses its data assets. The robust security features provided by Amazon S3, including encryption and durability, were used to provide data protection.

AWS 91

AWS Data Governance Data Silos SQL 91

KDnuggets

APRIL 14, 2023

list of Best Practices compiled from our learnings during our migration journey to the AWS cloud.

AWS 269

AWS Data Engineering Data Engineering Data Engineer 269

Analytics Vidhya

FEBRUARY 6, 2023

Introduction The demand for data to feed machine learning models, data science research, and time-sensitive insights is higher than ever thus, processing the data becomes complex. To make these processes efficient, data pipelines are necessary.

Data Pipeline 271

Data Pipeline Data Engineering Data Engineering Data Engineer 271

Analytics Vidhya

DECEMBER 28, 2022

Source: [link] Introduction If you are familiar with databases, or data warehouses, you have probably heard the term “ETL.” As the amount of data at organizations grow, making use of that data in analytics to derive business insights grows as well. For the […].

ETL 218

ETL AWS Data Warehouse Data Science 218

AWS Machine Learning Blog

FEBRUARY 21, 2025

The Hadoop environment was hosted on Amazon Elastic Compute Cloud (Amazon EC2) servers, managed in-house by Rockets technology team, while the data science experience infrastructure was hosted on premises. Communication between the two systems was established through Kerberized Apache Livy (HTTPS) connections over AWS PrivateLink.

Data Science 85

Data Science AWS Hadoop Data Scientist 85

Analytics Vidhya

NOVEMBER 2, 2022

This article was published as a part of the Data Science Blogathon. Source: [link] Introduction Amazon Web Services (AWS) is a cloud computing platform offering a wide range of services coming under domains like networking, storage, computing, security, databases, machine learning, etc.

Cloud Computing 369

Cloud Computing AWS Machine Learning Machine Learning 369

Flipboard

APRIL 11, 2025

Naveen Edapurath Vijayan is a Sr Manager of Data Engineering at AWS, specializing in data analytics and large-scale data systems. Artificial intelligence (AI) is transforming the way businesses analyze data, shifting from traditional business intelligence (BI) dashboards to real-time, automated

Analytics 145

Analytics Analytics Business Intelligence Business Intelligence 145

Data Science Dojo

OCTOBER 31, 2024

Familiarity with data preprocessing, feature engineering, and model evaluation techniques is crucial. Additionally, knowledge of cloud platforms (AWS, Google Cloud) and experience with deployment tools (Docker, Kubernetes) are highly valuable. This role builds a foundation for specialization.

Data Science 195

Data Science Data Scientist Machine Learning Machine Learning 195

AWS Machine Learning Blog

FEBRUARY 21, 2025

Lets assume that the question What date will AWS re:invent 2024 occur? The corresponding answer is also input as AWS re:Invent 2024 takes place on December 26, 2024. If the question was Whats the schedule for AWS events in December?, This setup uses the AWS SDK for Python (Boto3) to interact with AWS services.

AWS 130

AWS Natural Language Processing Machine Learning Machine Learning 130

Analytics Vidhya

NOVEMBER 26, 2020

Introduction: Gone are the days when enterprises set up their own in-house server and spending a gigantic amount of budget on storage infrastructure & The post Deployment of ML models in Cloud – AWS SageMaker?(in-built in-built algorithms) appeared first on Analytics Vidhya.

AWS 178

AWS ML ML Algorithm 178

Flipboard

APRIL 23, 2025

Solution overview The NER & LLM Gen AI Application is a document processing solution built on AWS that combines NER and LLMs to automate document analysis at scale. Click here to open the AWS console and follow along. The endpoint lifecycle is orchestrated through dedicated AWS Lambda functions that handle creation and deletion.

AWS 110

AWS ML ML AI 110

Flipboard

DECEMBER 18, 2023

Customers use Amazon Redshift as a key component of their data architecture to drive use cases from typical dashboarding to self-service analytics, real-time analytics, machine learning (ML), data sharing and monetization, and more. Hear also from Adidas, GlobalFoundries, and University of California, Irvine.

AWS 139

AWS Data Warehouse ETL SQL 139

AWS Machine Learning Blog

OCTOBER 24, 2024

Conventional ML development cycles take weeks to many months and requires sparse data science understanding and ML development skills. Business analysts’ ideas to use ML models often sit in prolonged backlogs because of data engineering and data science team’s bandwidth and data preparation activities.

Data Warehouse 118

Data Warehouse Machine Learning Machine Learning Cloud Data 118

Analytics Vidhya

MARCH 5, 2023

Introduction S3 is Amazon Web Services cloud-based object storage service (AWS). It stores and retrieves large amounts of data, including photos, movies, documents, and other files, in a durable, accessible, and scalable manner.

AWS 329

AWS Analytics Analytics Data Engineering 329

Analytics Vidhya

MARCH 5, 2023

Introduction Amazon Athena is an interactive query tool supplied by Amazon Web Services (AWS) that allows you to use conventional SQL queries to evaluate data stored in Amazon S3. Athena is a serverless service. Thus there are no servers to operate, and you pay for the queries you perform.

SQL 318

SQL AWS Analytics Analytics 318

Data Science Blog

SEPTEMBER 19, 2023

For Data Warehouse Systems that often require powerful (and expensive) computing resources, this level of control can translate into significant cost savings. Streamlined Collaboration Among Teams Data Warehouse Systems in the cloud often involve cross-functional teams — data engineers, data scientists, and system administrators.

Data Warehouse 259

Data Warehouse Azure SQL Database 259

phData

APRIL 24, 2025

phData, a leading AI and data services company, announced today that it has achieved the AWS Generative AI Competency as an AWS Service Delivery partner. Achieving the AWS Generative AI Competency strengthens our commitment to helping our clients adopt AI.

AWS 52

AWS AI AI Artificial Intelligence 52

AWS Machine Learning Blog

DECEMBER 4, 2024

Expand to generative AI use cases with your existing AWS and Tecton architecture After you’ve developed ML features using the Tecton and AWS architecture, you can extend your ML work to generative AI use cases. You can also find Tecton at AWS re:Invent. This process is shown in the following diagram.

ML 102

ML ML AWS AI 102

Analytics Vidhya

FEBRUARY 8, 2023

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehousing Amazon Web Services (AWS). It allows users to easily set up, operate, and scale a data warehouse in the cloud.

Data Warehouse 306

Data Warehouse AWS Analytics Analytics 306