Hacker News

JULY 1, 2025

reply veryfastfourier 3 hours ago | prev | next [–] Vola Dynamics | Data Engineer | Full-time | Hybrid | https://jobs.ashbyhq.com/voladynamics Vola Dynamics ( https://voladynamics.com ) is the world's most sophisticated software and quant research company for advanced options analytics.

Python 90

Python AWS ML ML 90

Analytics Vidhya

JANUARY 30, 2023

Introduction Azure Functions is a serverless computing service provided by Azure that provides users a platform to write code without having to provision or manage infrastructure in response to a variety of events. Azure functions allow developers […] The post How to Develop Serverless Code Using Azure Functions?

Azure 327

Azure Database Analytics Analytics 327

Data Science Blog

SEPTEMBER 19, 2023

In the contemporary age of Big Data, Data Warehouse Systems and Data Science Analytics Infrastructures have become an essential component for organizations to store, analyze, and make data-driven decisions. The post Why using Infrastructure as Code for developing Cloud-based Data Warehouse Systems?

Data Warehouse 259

Data Warehouse Azure SQL Database 259

ODSC - Open Data Science

DECEMBER 11, 2024

In a recent episode of ODSCs Ai X Podcast , we were privileged to discuss this dynamic area with Tamer Khraisha, a seasoned financial data engineer and author of the recent book Financial Data Engineering. This approach mitigates risks highlighted by incidents like cloud outages, ensuring continuity and resilience.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Smart Data Collective

JUNE 20, 2022

When data leaders move to the cloud, it’s easy to get caught up in the features and capabilities of various cloud services without thinking about the day-to-day workflow of data scientists and data engineers.

Data Engineering 145

Data Engineering Data Engineer Data Engineering Data Engineering 145

AWS Machine Learning Blog

JULY 10, 2024

Amazon Q can also help employees do more with the vast troves of data and information contained in their company’s documents, systems, and applications by answering questions, providing summaries, generating business intelligence (BI) dashboards and reports, and even generating applications that automate key tasks.

AWS 143

AWS Machine Learning Machine Learning Database 143

AWS Machine Learning Blog

AUGUST 8, 2023

Refer to the AWS documentation for additional information: For SageMaker Processing, refer to PySparkProcessor For AWS Glue Interactive Sessions, refer to Configuring the Spark UI (console) For Amazon EMR, refer to Configure an output location You can choose the generated URL to access the Spark UI.

AWS 97

AWS Clustering Machine Learning Machine Learning 97

The MLOps Blog

JUNE 27, 2023

Alignment to other tools in the organization’s tech stack Consider how well the MLOps tool integrates with your existing tools and workflows, such as data sources, data engineering platforms, code repositories, CI/CD pipelines, monitoring systems, etc. Check out the Kubeflow documentation. For example, neptune.ai

Machine Learning 134

Machine Learning Machine Learning ML ML 134

Pickl AI

AUGUST 27, 2024

Read Blog: Virtualisation in Cloud Computing and its Diverse Forms. Explore More: Big Data Engineers: An In-depth Analysis. Edge Computing vs. Cloud Computing: Pros, Cons, and Future Trends. Also Check: What is Data Integration in Data Mining with Example? What is Cloud Computing?

Cloud Computing 52

Cloud Computing Data Science Clustering Data Mining 52

Towards AI

FEBRUARY 11, 2025

2020) Scaling Laws for Neural Language Models [link] First formal study documenting empirical scaling laws Published by OpenAI The Data Quality Conundrum Not all data is created equal. This method not only expands the available training data but also enhances model efficiency and problem-solving abilities.

Data Quality 56

Data Quality Data Engineering Data Engineer Data Engineering 56

Alation

OCTOBER 12, 2021

One may define enterprise data analytics as the ability to find, understand, analyze, and trust data to drive strategy and decision-making. Enterprise data analytics integrates data, business, and analytics disciplines, including: Data management. Data engineering. Evaluate and monitor data quality.

Analytics 52

Analytics Analytics Data Governance DataOps 52

Alation

JANUARY 17, 2023

These tools are used to manage big data, which is defined as data that is too large or complex to be processed by traditional means. How Did the Modern Data Stack Get Started? The rise of cloud computing and cloud data warehousing has catalyzed the growth of the modern data stack.

Data Warehouse 52

Data Warehouse ETL Tableau Cloud Data 52

Mlearning.ai

FEBRUARY 16, 2023

Therefore, you’ll be empowered to truncate and reprocess data if bugs are detected and provide an excellent raw data source for data scientists. Use Multiple Data Models With on-premise data warehouses, storing multiple copies of data can be too expensive. What will You Attain with Snowflake?

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

Dataconomy

MAY 2, 2023

Familiarity with machine learning frameworks, data structures, and algorithms is also essential. Additionally, expertise in big data technologies, database management systems, cloud computing platforms, problem-solving, critical thinking, and collaboration is necessary. How data engineers tame Big Data?

ML 110

ML ML Machine Learning Machine Learning 110

Pickl AI

MAY 15, 2024

Invest in Version Control and Documentation Use version control systems like Git to track changes in code, models, and data pipelines. This facilitates collaboration, rollbacks if needed, and simplifies future maintenance and updates. Familiarize yourself with their services for data storage, processing, and model deployment.

Data Analyst 52

Data Analyst Data Scientist Data Science Machine Learning 52

DrivenData Labs

DECEMBER 11, 2024

One unavoidable observation from the past ten years is that the pace of technological innovation, especially in data and AI, has been dizzying. For example, datasets in a machine-readable format that come with clear documentation and a demonstration of use are much better at getting attention and engagement.

Data Science 147

Data Science Data Scientist Machine Learning Machine Learning 147

Pickl AI

SEPTEMBER 5, 2024

By leveraging Azure’s capabilities, you can gain the skills and experience needed to excel in this dynamic field and contribute to cutting-edge data solutions. Microsoft Azure, often referred to as Azure, is a robust cloud computing platform developed by Microsoft. What is Azure?

Azure 52

Azure Data Scientist Data Science Machine Learning 52

ODSC - Open Data Science

SEPTEMBER 12, 2024

US Proposes Mandatory Reporting for AI and Cloud Providers The U.S. Commerce Department has announced a new proposal aimed at enhancing the safety and security of AI and cloud computing services. When your data consists of various patient chart document types (e.g.

Data Visualization 40

Data Visualization Data Science AI AI 40

phData

MAY 25, 2023

Snowflake is a cloud computing–based data cloud company that provides data warehousing services that are far more scalable and flexible than traditional data warehousing products. For more information on composite models, check out Microsoft’s official documentation.

Power BI 84

Power BI Analytics Analytics Azure 84

The MLOps Blog

DECEMBER 7, 2022

The inherent cost of cloud computing : To illustrate the point, Argentina’s minimum wage is currently around 200 dollars per month. Quick shout out to the amazing data engineering team at CTF Capital, they really poured their hearts and brains into this! The bad Let’s start with the not-so-cool first.

ML 52

ML ML ETL AWS 52

AWS Machine Learning Blog

JANUARY 26, 2024

This is backed by our deep set of over 300 cloud security tools and the trust of our millions of customers, including the most security-sensitive organizations like government, healthcare, and financial services.

AWS 137

AWS ML ML AI 137