Course Outline

Foundations of Data-Intensive Platform Engineering

  • Introduction to data-intensive applications
  • Challenges in platform engineering for big data
  • Overview of data processing architectures

Data Modeling and Management

  • Principles of data modeling for scalability
  • Data storage options and optimization
  • Managing data lifecycle in a distributed environment

Big Data Processing Frameworks

  • Overview of big data processing tools (Hadoop, Spark, Flink)
  • Batch vs. stream processing
  • Setting up a big data processing pipeline

Real-Time Analytics Platforms

  • Architecting for real-time analytics
  • Stream processing engines (Kafka Streams, Apache Storm)
  • Building real-time dashboards and visualizations

Data Pipeline Orchestration

  • Workflow management with Apache Airflow and others
  • Automating data pipelines for efficiency
  • Monitoring and alerting for data pipelines

Platform Security and Compliance

  • Security best practices for data platforms
  • Ensuring data privacy and regulatory compliance
  • Implementing secure data access controls

Performance Tuning and Optimization

  • Techniques for optimizing data throughput and latency
  • Scaling strategies for data-intensive platforms
  • Performance benchmarking and monitoring

Case Studies and Best Practices

  • Analyzing successful data platform implementations
  • Lessons learned from industry leaders
  • Emerging trends in data-intensive platform engineering

Capstone Project

  • Designing a platform solution for a data-intensive application
  • Implementing a prototype of the data processing pipeline
  • Evaluating the platform's performance and scalability

Summary and Next Steps

Requirements

  • An understanding of basic data structures and algorithms
  • Experience with Java, Scala, or Python programming
  • Familiarity with basic concepts of databases and SQL

Audience

  • Software developers
  • Data engineers
  • Technical leads
 21 Hours

Number of participants



Price per participant

Testimonials (4)

Related Courses

Advanced Platform Engineering: Scaling with Microservices and Kubernetes

35 Hours

DevOps and Platform Engineering: A Collaborative Approach

14 Hours

Platform Engineering Fundamentals

14 Hours

Platform Engineering for Business Strategy and Management

21 Hours

Platform Engineering with Cloud-Native Technologies

28 Hours

Platform Engineering for Developers

21 Hours

Platform Engineering: Security and Compliance

28 Hours

AI-Augmented Software Engineering (AIASE)

14 Hours

AI Coding Assistants: Enhancing Developer Productivity

7 Hours

FlexNet Publisher Fundamentals

14 Hours

Impacted Function Point (IFP)

7 Hours

IREB CPRE Foundation - przygotowanie do egzaminu

21 Hours

SNAP IFPUG Software Size Estimation and Measurement

14 Hours

Software Engineering

35 Hours

Unit of Software Measurement Parameterization (UMSP)

7 Hours

Related Categories

1