KDnuggets

JUNE 11, 2025

By subscribing you accept KDnuggets Privacy Policy Leave this field empty if youre human: Latest Posts Bridging the Gap: New Datasets Push Recommender Research Toward Real-World Scale Top 7 MCP Clients for AI Tooling Why You Need RAG to Stay Relevant as a Data Scientist Stop Writing Messy Python: A Clean Code Crash Course Selling Your Side Project?

Natural Language Processing 308

Natural Language Processing Data Science Machine Learning Machine Learning 308

Flipboard

JUNE 13, 2025

Blog Top Posts About Topics AI Career Advice Computer Vision Data Engineering Data Science Language Models Machine Learning MLOps NLP Programming Python SQL Datasets Events Resources Cheat Sheets Recommendations Tech Briefs Advertise Join Newsletter AI Agents in Analytics Workflows: Too Early or Already Behind?

Analytics 157

Analytics Analytics Data Science Natural Language Processing 157

Analytics Vidhya

OCTOBER 19, 2021

In this tutorial, you will see the top 5 features that developers should know before implementing a solution on the Snowflake data […]. The post 5 Features Of Snowflake That Data Engineers Must Know appeared first on Analytics Vidhya.

Data Engineering 400

Data Engineering Data Engineer Data Engineering Data Engineering 400

Dataconomy

JUNE 12, 2025

Data engineers are the unsung heroes of the data-driven world, laying the essential groundwork that allows organizations to leverage their data for enhanced decision-making and strategic insights. What is a data engineer?

Data Engineering 91

Data Engineering Data Engineering Data Engineer Data Engineering 91

KDnuggets

JUNE 9, 2025

By subscribing you accept KDnuggets Privacy Policy Leave this field empty if youre human: Latest Posts Run the Full DeepSeek-R1-0528 Model Locally 7 Cool Python Projects to Automate the Boring Stuff 5 Error Handling Patterns in Python (Beyond Try-Except) 10 Awesome OCR Models for 2025 WTF is GRPO?!?

Natural Language Processing 323

Natural Language Processing Data Science Machine Learning Machine Learning 323

Analytics Vidhya

SEPTEMBER 26, 2022

The post Web Scrapping- Tool for Data Engineering appeared first on Analytics Vidhya. The usefulness of the topic is one that easily helps other disciplines. Web content could be required in a way that makes it less effective to visit and use a website […].

Data Engineering 364

Data Engineering Data Engineer Data Engineering Data Engineering 364

Data Science Dojo

MARCH 8, 2023

Python has become a popular programming language in the data science community due to its simplicity, flexibility, and wide range of libraries and tools. Learn the basics of Python programming  Before you start with data science, it’s essential to have a solid understanding of its programming concepts.

Data Science 494

Data Science Python Machine Learning Machine Learning 494

Analytics Vidhya

MARCH 17, 2022

Prior to developing intelligent data products, however, the frequently overlooked core work required to make it happen, […]. The post A Quick Overview of Data Engineering appeared first on Analytics Vidhya.

Data Engineering 327

Data Engineering Data Engineer Data Engineering Data Engineering 327

Analytics Vidhya

NOVEMBER 19, 2020

The post Data Engineering 101 – Getting Started with Apache Airflow appeared first on Analytics Vidhya. Overview Understanding the need for Apache Airflow and its components We will create our first DAG to get live cricket scores using Apache Airflow.

Data Engineering 329

Data Engineering Data Engineering Data Engineer Data Engineering 329

Flipboard

JUNE 6, 2025

Sign in Sign out Contributor Portal Latest Editor’s Picks Deep Dives Contribute Newsletter Toggle Mobile Navigation LinkedIn X Toggle Search Search Data Science How I Automated My Machine Learning Workflow with Just 10 Lines of Python Use LazyPredict and PyCaret to skip the grunt work and jump straight to performance.

Machine Learning 163

Machine Learning Machine Learning Python Data Science 163

Analytics Vidhya

JULY 11, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction- In this article, we will explore Apache Spark and PySpark, The post Know About Apache Spark Using PySpark for Data Engineering appeared first on Analytics Vidhya.

Data Engineering 329

Data Engineering Data Engineering Data Engineer Data Engineering 329

Analytics Vidhya

JANUARY 2, 2023

And so, there is no doubt that Data Engineers use it extensively to build and manage their ETL pipelines. The post Data Engineering 101– BranchPythonOperator in Apache Airflow appeared first on Analytics Vidhya. But not all the pipelines you build in Airflow will be straightforward.

Data Engineering 306

Data Engineering Data Engineering Data Engineer Data Engineering 306

Flipboard

JUNE 9, 2025

By Bala Priya C , KDnuggets Contributing Editor & Technical Content Specialist on June 9, 2025 in Python Image by Author | Ideogram Have you ever spent several hours on repetitive tasks that leave you feeling bored and… unproductive? But you can automate most of this boring stuff with Python. I totally get it. Let’s get started.

Python 159

Python Natural Language Processing Data Science Machine Learning 159

Analytics Vidhya

SEPTEMBER 2, 2021

Poor data results in poor judgments. Running unit tests in data science and data engineering projects assures data quality. The post Unit Test framework and Test Driven Development (TDD) in Python appeared first on Analytics Vidhya. You know your code does what you want it to do.

Python 342

Python Data Science Data Quality Data Engineering 342

Analytics Vidhya

SEPTEMBER 30, 2021

This article was published as a part of the Data Science Blogathon Introduction Apache Spark is a big data processing framework that has long become one of the most popular and frequently encountered in all kinds of projects related to Big Data.

Data Engineering 318

Data Engineering Data Engineering Data Engineer Data Engineering 318

Analytics Vidhya

AUGUST 16, 2020

Introduction We are aware of the massive amounts of data being produced each day. This humungous data has lots of insights and hidden trends. The post Analysing Streaming Tweets with Python and PostgreSQL appeared first on Analytics Vidhya.

Python 400

Python Analytics Analytics Data Engineering 400

Analytics Vidhya

JUNE 20, 2023

Introduction In today’s data-driven world, organizations across industries are dealing with massive volumes of data, complex pipelines, and the need for efficient data processing.

Data Engineering 305

Data Engineering Data Engineer Data Engineering Data Engineering 305

Analytics Vidhya

JANUARY 2, 2023

While not all of us are tech enthusiasts, we all have a fair knowledge of how Data Science works in our day-to-day lives. All of this is based on Data Science which is […]. The post Step-by-Step Roadmap to Become a Data Engineer in 2023 appeared first on Analytics Vidhya.

Data Engineering 329

Data Engineering Data Engineer Data Engineering Data Engineering 329

Analytics Vidhya

AUGUST 4, 2024

The Kaggle Grandmaster is proficient in analyzing data, engineering features, and building various models, and the participant also shares his/her knowledge with the community. Dedication to getting to the top of […] The post Are You Using These Kaagle Grandmaster-Approved Python Libraries?

Python 287

Python Data Engineering Data Engineering Data Engineer 287

KDnuggets

JUNE 11, 2025

If you want to follow similar articles, solve 700+ interview questions related to Data Science, and 50+ Data projects, visit my platform. Nate Rosidi is a data scientist and in product strategy. Nate writes on the latest trends in the career market, gives interview advice, shares data science projects, and covers everything SQL.

Data Scientist 245

Data Scientist Data Science Natural Language Processing Machine Learning 245

KDnuggets

JUNE 13, 2025

Our Top 5 Free Course Recommendations --> Get the FREE ebook The Great Big Natural Language Processing Primer and The Complete Collection of Data Science Cheat Sheets along with the leading newsletter on Data Science, Machine Learning, AI & Analytics straight to your inbox.

Natural Language Processing 315

Natural Language Processing Data Science Machine Learning Machine Learning 315

Analytics Vidhya

JANUARY 25, 2023

Redis supports several data types, including strings, lists, sets, and hyperloglogs. Redis-py is one of the most used Redis Clients for python to access the Redis […] The post Introduction to Redis OM in Python appeared first on Analytics Vidhya.

Python 353

Python Database Analytics Analytics 353

Analytics Vidhya

MAY 30, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction Big data is the collection of data that is vast. The post Integration of Python with Hadoop and Spark appeared first on Analytics Vidhya.

Hadoop 367

Hadoop Python Big Data Big Data 367

Analytics Vidhya

SEPTEMBER 16, 2021

The post Essential PySpark DataFrame Column Operations that Data Engineers Should Know appeared first on Analytics Vidhya. It is important to know these operations as one may always require any or all of these while performing any PySpark Exercise. PySpark DataFrame is built over Spark’s […].

Data Engineering 307

Data Engineering Data Engineer Data Engineering Data Engineering 307

Analytics Vidhya

JULY 23, 2022

CouchDB is similar to MongoDB and uses JSON, also known as Javascript Object Notation, to store data, […]. The post Introduction to Apache CouchDB using Python appeared first on Analytics Vidhya.

Python 367

Python Database Data Science Analytics 367

Analytics Vidhya

FEBRUARY 6, 2023

Introduction While working with multiple projects, there are chances of issues with versions of packages in python; for example, a project needs a new version of a package, and another requires a different version. Sometimes the python version itself changes from project to project.

Python 316

Python Analytics Analytics Data Engineering 316

Analytics Vidhya

DECEMBER 5, 2022

The post Using AWS S3 with Python boto3 appeared first on Analytics Vidhya. It allows users to store and retrieve files quickly and securely from anywhere. Users can combine S3 with other services to build numerous scalable […].

AWS 362

AWS Python Data Science Analytics 362

Analytics Vidhya

JULY 12, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction Pandas have come a long way on their own, and. The post Pandasql -The Best Way to Run SQL Queries in Python appeared first on Analytics Vidhya.

SQL 364

SQL Python Data Science Analytics 364

Analytics Vidhya

JUNE 20, 2021

ArticleVideo Book This article was published as a part of the Data Science Blogathon Introduction Data warehouse generalizes and mingles data in multidimensional space. The post How to Build a Data Warehouse Using PostgreSQL in Python? appeared first on Analytics Vidhya.

Data Warehouse 364

Data Warehouse Python Data Science Analytics 364

Analytics Vidhya

FEBRUARY 28, 2023

Introduction Apache Spark is a powerful big data processing engine that has gained widespread popularity recently due to its ability to process massive amounts of data types quickly and efficiently. While Spark can be used with several programming languages, Python and Scala are popular for building Spark applications.

Python 347

Python Big Data Big Data Analytics 347

KDnuggets

APRIL 19, 2024

The collection includes free courses on Python, SQL, Data Analytics, Business Intelligence, Data Engineering, Machine Learning, Deep Learning, Generative AI, and MLOps.

Data Science 373

Data Science Deep Learning Deep Learning Business Intelligence 373

Analytics Vidhya

APRIL 21, 2022

Introduction In this article, we will be getting our hands dirty with PySpark using Python and understand how to get started with data preprocessing using PySpark. This particular article’s whole attention is to get to know how PySpark can help in the data cleaning process […].

Python 305

Python Data Science Analytics Analytics 305

Analytics Vidhya

AUGUST 25, 2021

This article was published as a part of the Data Science Blogathon Introduction Let’s look at a practical example of how to make SQL queries to a MySQL server from Python code: CREATE, SELECT, UPDATE, JOIN, etc. Most applications interact with data in some form. Python is no exception) provide tools for storing […].

Data Analysis 291

Data Analysis Data Analysis Python SQL 291

KDnuggets

JUNE 12, 2025

py # (Optional) to mark directory as Python package You can leave the __init.py__ file empty, as its main purpose is simply to indicate that this directory should be treated as a Python package. Tools Required(requirements.txt) The necessary libraries required are: PyPDF : A pure Python library to read and write PDF files.

Data Science 265

Data Science Natural Language Processing Python Machine Learning 265

KDnuggets

JUNE 17, 2025

With Modal, you can configure your Python app, including system requirements like GPUs, Docker images, and Python dependencies, and then deploy it to the cloud with a single command. It is an ideal platform for beginners, data scientists, and non-software engineering professionals who want to avoid dealing with cloud infrastructure.

178

178

Analytics Vidhya

JULY 16, 2022

The post Introduction to Google Firebase Cloud Storage using Python appeared first on Analytics Vidhya. It aims to replace conventional backend servers for web and mobile applications by offering multiple services on the same platform like authentication, real-time database, Firestore (NoSQL database), cloud functions, […].

Python 291

Python Database Data Science Analytics 291

Analytics Vidhya

AUGUST 28, 2022

The post Movies Recommendation System using Python appeared first on Analytics Vidhya. Further, going forward, many platforms emerged like Aha, Hotstar, Netflix, Amazon prime video, Zee5, Sony Liv, and many more. First, we will see a video or […].

Python 271

Python Data Science Analytics Analytics 271