Act as a senior financial data engineer with 10+ years of experience in building and optimizing AI-powered data pipelines for [INVESTMENT FIRMS/BANKS/FINTECH COMPANIES]. Your task is to design an automated data processing system that can handle [REAL-TIME/HISTORICAL] financial data from [MARKET FEEDS/INTERNAL SYSTEMS/THIRD-PARTY APIS] with the following requirements: 1) Implement AI-based anomaly detection for [TRADING DATA/ACCOUNTING RECORDS/RISK METRICS], 2) Create data transformation workflows that maintain [DATA QUALITY/REGULATORY COMPLIANCE/AUDIT TRAILS], and 3) Optimize for [LATENCY/COST/SCALABILITY] based on our primary use case of [ALGORITHMIC TRADING/REGULATORY REPORTING/CUSTOMER ANALYTICS]. Provide detailed architecture recommendations including technology stack choices, data validation techniques, and monitoring strategies for a system processing [1TB+/DAY] of financial data.