Data Processing
- What should you consider before choosing a data processing service?
- real-timeReal-time data processing* Immediate analytics Example in healthcare: * Real-time - hospital emergency dashboards (heart rate monitoring) Status: #idea Tags: Data Processing References or batchBatch data processing* Scheduled or ad-hoc analytics Example in healthcare: * Batch - weekly-updated dashboards (inventory management for hospital equipment) Status: #idea Tags: Data Processing References
- Different infrastructure and cost implications
Azure Processing Tools
- Azure Synapse AnalyticsAzure Synapse Analytics* Part of Microsoft Fabric * integrates big data and data warehouses * Unified experience for data ingestion, preparation, management, and delivery * Supports real-time insights and batch processing * Acts as a turbocharged analytics engine Similar to AWS Redshift Status: #idea Tags: az-900, azure, cloud, data processing, data analytics References
- Azure Stream AnalyticsAzure Stream Analytics* Enables real-time data access * Sets up real-time analytics with straightforward query definition * Handles data streaming from diverse inputs like blob storage * Essential for immediate insights: * fraud detection in a bank * dynamic pricing on the stock market Similar to AWS Kinesis Status: #idea Tags: az-900, azure, cloud, data analytics References
- Azure DatabricksAzure Databricks* Microsoft-Databricks collaboration * Analytics platform optimized for Azure * Unified environment for data engineering, analytics, and machine learning Collaborative** workspace for data scientists and engineers * Built-in Data Lake support Real-time and batch** Status: #idea Tags: az-900, azure, cloud, data processing, data analytics References
- Azure Data FactoryAzure Data Factory* Cloud-based integration service * Creates, schedules, orchestrates data workflows Streamlines ETL processes** * Handles diverse data sources (SQL and NoSQL) and formats * Automates workflows for flexibility Status: #idea Tags: az-900, azure, cloud, data processing References
- Azure HDInsightAzure HDInsight* Managed service for fast, customizable data processing * Runs on popular open-source platforms: * Hadoop * Spark * Kafka Easily scales** resources based on demand Seamlessly connects with Azure storage** solutions Similar to AWS EMR Status: #idea Tags: az-900, azure, cloud, data processing References
Status: #idea
Tags: cloud