Hacker News

JULY 1, 2025

dustanbower 7 minutes ago | next [–] Location: Virginia, United States Remote: Yes (have worked exclusively remotely for past 14 years) Willing to relocate: No I've been doing backend work for the past 14 years, with Python, Django, and Django REST Framework. Interested in Python work or full-stack with Python.

Python 56

Python AWS SQL ML 56

Pickl AI

MARCH 19, 2025

Summary: Data engineering tools streamline data collection, storage, and processing. Tools like Python, SQL, Apache Spark, and Snowflake help engineers automate workflows and improve efficiency. Learning these tools is crucial for building scalable data pipelines.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

Hacker News

JULY 23, 2025

Click to sign up to matthewsinclair.com Scan to sign up to matthewsinclair.com Home About Blogs Coaching Projects Speaking Meta quantumfaxmachine.com geodica.com whatnext.dev © 2024 Matthew Sinclair. This opens the door to real-time inference, model serving, and continuous learning at the edge — directly in your web app or API.

Clustering 98

Clustering ML ML Data Pipeline 98

Hacker News

JULY 1, 2025

Good at Go, Kubernetes (Understanding how to manage stateful services in a multi-cloud environment) We have a Python service in our Recommendation pipeline, so some ML/Data Science knowledge would be good. Data extraction and massage, delivery to destinations like Google/Meta/TikTok/etc.

Python 78

Python AWS ML ML 78

Hacker News

JUNE 29, 2025

It's a programming language designed for writing good CLI scripts, so it's aiming to replace Bash but is much more Python-like, and offers unique syntax and a bunch of in-built support for scripting. Uses lldb's Python scripting extensions to register commands, and handle memory access.

AI 82

AI AI Database Python 82

ODSC - Open Data Science

DECEMBER 14, 2023

Using Guardrails for Trustworthy AI, Projected AI Trends for 2024, and the Top Remote AI Jobs in 2024 How to Use Guardrails to Design Safe and Trustworthy AI In this article, you’ll get a better understanding of guardrails within the context of this post and how to set them at each stage of AI design and development. Learn more here!

K-nearest Neighbors 97

K-nearest Neighbors AI AI Machine Learning 97

ODSC - Open Data Science

DECEMBER 19, 2023

So let’s check out some of the top remote AI jobs for pros to look out for in 2024. Data Scientist Data scientists are responsible for developing and implementing AI models. They use their knowledge of statistics, mathematics, and programming to analyze data and identify patterns that can be used to improve business processes.

Data Scientist 96

Data Scientist Machine Learning Machine Learning Computer Science 96

PyImageSearch

JANUARY 15, 2024

Home Table of Contents Adversarial Learning with Keras and TensorFlow (Part 2): Implementing the Neural Structured Learning (NSL) Framework and Building a Data Pipeline Adversarial Learning with NSL CIFAR-10 Dataset Configuring Your Development Environment Need Help Configuring Your Development Environment?

Data Pipeline 67

Data Pipeline Deep Learning Deep Learning Computer Science 67

Ocean Protocol

FEBRUARY 28, 2024

Goal: Accelerate Ocean Predictoor - Background - Plans 2024 3. Goal: Launch C2D Springboard - Background - Plans 2024 4. Ongoing - Data Challenges - Data Farming - Ecosystem support 6. Introduction Ocean Protocol was founded to level the playing field for AI and data .In For 2024, we focus on these.

Data Scientist 64

Data Scientist Data Pipeline Algorithm AI 64

Pickl AI

MARCH 7, 2024

Summary: In 2024, mastering essential Data Science tools will be pivotal for career growth and problem-solving prowess. Tools like Seaborn, R, Python, and PyTorch are integral for extracting actionable insights and enhancing career prospects. It offers various libraries and frameworks for various Data Science tasks.

Data Science 52

Data Science Machine Learning Machine Learning Python 52

ODSC - Open Data Science

JANUARY 30, 2024

Not only does it involve the process of collecting, storing, and processing data so that it can be used for analysis and decision-making, but these professionals are responsible for building and maintaining the infrastructure that makes this possible; and so much more. Think of data engineers as the architects of the data ecosystem.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

phData

JULY 2, 2024

Snowpark, offered by the Snowflake AI Data Cloud , consists of libraries and runtimes that enable secure deployment and processing of non-SQL code, such as Python, Java, and Scala. In this blog, we’ll cover the steps to get started, including: How to set up an existing Snowpark project on your local system using a Python IDE.

Python 52

Python SQL Data Pipeline ML 52

Towards AI

MAY 30, 2024

Last Updated on June 3, 2024 by Editorial Team Author(s): Towards AI Editorial Team Originally published on Towards AI. Prime_otter_86438 is working on a Python library to make ML training and running models on any microcontroller in real time for classification easy for beginners. Good morning, fellow learners.

AI 94

AI AI Data Pipeline Deep Learning 94

Towards AI

FEBRUARY 29, 2024

Last Updated on February 29, 2024 by Editorial Team Author(s): Hira Akram Originally published on Towards AI. Diagram by author As technology continues to advance, the generation of data increases exponentially. In this dynamically changing landscape, businesses must pivot towards data-driven models to maintain a competitive edge.

Apache Kafka 142

Apache Kafka SQL Clustering Data Pipeline 142

Pickl AI

MAY 15, 2024

But the allure of tackling large-scale projects, building robust models for complex problems, and orchestrating data pipelines might be pushing you to transition into Data Science architecture. So if you are looking forward to a Data Science career , this blog will work as a guiding light.

Data Analyst 52

Data Analyst Data Scientist Data Science Machine Learning 52

ODSC - Open Data Science

MAY 9, 2024

With 2024 surging along, the world of AI and the landscape being created by large language models continues to evolve in a dynamic manner. Innovative AI Tools for 2024 Cosmopedia Now think about this. Whether you’re managing data pipelines or deploying machine learning models, Thunder makes the process smooth and efficient.

Machine Learning 52

Machine Learning Machine Learning AI AI 52

BAIR

FEBRUARY 17, 2024

We argue that compound AI systems will likely be the best way to maximize AI results in the future , and might be one of the most impactful trends in AI in 2024. Python code that calls an LLM), or should it be driven by an AI model (e.g. Increasingly many new AI results are from compound systems. Why Use Compound AI Systems?

AI 145

AI AI DataOps Data Pipeline 145

DagsHub

APRIL 7, 2024

Image generated with Midjourney In today’s fast-paced world of data science, building impactful machine learning models relies on much more than selecting the best algorithm for the job. Data scientists and machine learning engineers need to collaborate to make sure that together with the model, they develop robust data pipelines.

Machine Learning 59

Machine Learning Machine Learning ML ML 59

ODSC - Open Data Science

FEBRUARY 15, 2024

With an exploration of real-world data, this session will equip you with the knowledge to immediately retrain better models. These systems represent data as knowledge graphs and implement graph traversal algorithms to help find content in massive datasets. So get your pass today, and keep yourself ahead of the curve.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

ODSC - Open Data Science

DECEMBER 5, 2023

While we may be done with events for 2023, 2024 is looking to be packed full of conferences, meetups, and virtual events. On the horizon is ODSC East 2024, which is shaping up to be just as packed with content as ODSC West was, but with its own spin on things. What’s next? Right now, tickets are 75% off for a limited time!

Data Science 98

Data Science Artificial Intelligence Artificial Intelligence Machine Learning 98

phData

JULY 1, 2024

The recent Snowflake Summit 2024 brought plenty of exciting upcoming features, GA announcements, strategic partnerships, and many more opportunities for customers on the Snowflake AI Data Cloud to innovate. Likewise, Snowflake Summit 2024 showed no shortage of exciting upcoming features for Snowflake Cortex AI.

Python 52

Python Database Data Pipeline SQL 52

Pickl AI

NOVEMBER 4, 2024

Effective data governance enhances quality and security throughout the data lifecycle. What is Data Engineering? Data Engineering is designing, constructing, and managing systems that enable data collection, storage, and analysis. The global data warehouse as a service market was valued at USD 9.06

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

DagsHub

APRIL 21, 2024

Best MLOps Tools & Platforms for 2024 In this section, you will learn about the top MLOps tools and platforms that are commonly used across organizations for managing machine learning pipelines. Data storage and versioning Some of the most popular data storage and versioning tools are Git and DVC.

Machine Learning 59

Machine Learning Machine Learning ML ML 59

DagsHub

MAY 7, 2024

The below image shows a machine learning model testing pipeline proposed by Jeremy Jordan that incorporates these best practices: Tools for Testing Machine Learning Models 1. GitHub stars) Deepchecks is an open-source Python tool for validating machine learning models and data. Deepchecks (3.3k

Machine Learning 52

Machine Learning Machine Learning ML ML 52

DagsHub

MAY 7, 2024

The below image shows a machine learning model testing pipeline proposed by Jeremy Jordan that incorporates these best practices: Tools for Testing Machine Learning Models 1. GitHub stars) Deepchecks is an open-source Python tool for validating machine learning models and data. Deepchecks (3.3k

Machine Learning 52

Machine Learning Machine Learning ML ML 52

DagsHub

DECEMBER 5, 2023

The Git integration means that experiments are automatically reproducible and linked to their code, data, pipelines, and models. We can interact with the platform using either a web interface or a Python API. ClearML allows multiple users to collaborate on the same project, enabling easy sharing of experiments and data.

Machine Learning 52

Machine Learning Machine Learning ML ML 52

ODSC - Open Data Science

JANUARY 18, 2024

Data engineers will also work with data scientists to design and implement data pipelines; ensuring steady flows and minimal issues for data teams. They’ll also work with software engineers to ensure that the data infrastructure is scalable and reliable. Learn more about the cloud.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

Ocean Protocol

JANUARY 17, 2024

We launched Predictoor and its Data Farming incentives in September & November 2023, respectively. The pdr-backend GitHub repo has the Python code for all bots: Predictoor bots, Trader bots, and support bots (submitting true values, buying on behalf of DF, etc). Ref DappRadar Jan 17, 2024 Ocean Predictoor Volume vs time.

Data Pipeline 52

Data Pipeline AI AI Analytics 52

ODSC - Open Data Science

JANUARY 28, 2025

AI Trends of 2024 and Predictions for2025 Reflecting on 2024, McGovern highlighted its breakout nature for AI, driven by advancements in industry applications and the maturation of tools like ChatGPT. LLM Engineers: With job postings far exceeding the current talent pool, this role has become one of the hottest inAI.

AI 40

AI AI Machine Learning Machine Learning 40

PyImageSearch

FEBRUARY 5, 2024

Implementing Precision and Recall Calculations in Python Now that we have defined and segregated our samples into True Positives , True Negatives , False Positives , and False Negatives , let us try to use them to compute specific metrics to evaluate our model. label_pred !=1 1 ), and their ground-truth label was positive ( label_gt =1 ).

Database 62

Database Data Pipeline Deep Learning Deep Learning 62

phData

DECEMBER 4, 2023

This blog was originally written by Erik Hyrkas and updated for 2024 by Justin Delisi This isn’t meant to be a technical how-to guide — most of those details are readily available via a quick Google search — but rather an opinionated review of key processes and potential approaches. You can use whatever works best for your technology.

Clustering 98

Clustering Database SQL Data Pipeline 98

Precisely

AUGUST 15, 2024

A recent TDWI Best Practices Report found that top priority outcomes for digital business transformation in 2024 include: increased operational efficiency better data-driven decisions superior customer experiences How are businesses planning to achieve these goals and more?

AI 65

AI AI Data Quality Data Engineering 65

AWS Machine Learning Blog

SEPTEMBER 11, 2024

In terms of resulting speedups, the approximate order is programming hardware, then programming against PBA APIs, then programming in an unmanaged language such as C++, then a managed language such as Python. In March 2024, AWS announced it will offer the new NVIDIA Blackwell platform, featuring the new GB200 Grace Blackwell chip.

AWS 115

AWS ML ML Clustering 115

Pickl AI

JUNE 7, 2024

This blog will delve into ETL Tools, exploring the top contenders and their roles in modern data integration. Let’s unlock the power of ETL Tools for seamless data handling. Also Read: Top 10 Data Science tools for 2024. It is a process for moving and managing data from various sources to a central data warehouse.

ETL 40

ETL Hadoop Data Warehouse Data Quality 40

Pickl AI

DECEMBER 9, 2024

Introduction Big Data continues transforming industries, making it a vital asset in 2025. The global Big Data Analytics market, valued at $307.51 billion in 2024 and reach a staggering $924.39 Companies actively seek experts to manage and analyse their data-driven strategies. billion in 2023, is projected to grow to $348.21

Big Data 52

Big Data Big Data Hadoop Apache Kafka 52

BAIR

FEBRUARY 18, 2024

We argue that compound AI systems will likely be the best way to maximize AI results in the future , and might be one of the most impactful trends in AI in 2024. Python code that calls an LLM), or should it be driven by an AI model (e.g. Increasingly many new AI results are from compound systems. Why Use Compound AI Systems?

AI 40

AI AI DataOps Data Pipeline 40

PyImageSearch

JANUARY 8, 2024

We will understand the dataset and the data pipeline for our application and discuss the salient features of the NSL framework in detail. config.py ) The data pipeline (i.e., Next, in the 3rd part of this tutorial series, we will discuss two types of adversarial attacks used to engineer adversarial examples.

Deep Learning 67

Deep Learning Deep Learning Data Pipeline Computer Science 67