Multi-Regional Geospatial ML Infrastructure
At Pixxel, multi-regional ML infrastructure improved inference efficiency by 75%, reduced map-rendering latency by 50%, and supported ETL and ML pipelines processing more than 1 TB each day.
- Processed daily
- 1TB+
- Inference-efficiency improvement
- 75%
- Lower map-rendering latency
- 50%
Confidentiality note. Employer-specific implementation details, internal names, and proprietary scientific context have been intentionally generalized. The scale, responsibilities, technologies, and outcomes below are limited to facts already published in Sudhanva’s résumé and professional profile.
Problem
Geospatial analytics combined large daily data volumes, regional model selection, GPU scheduling, and latency-sensitive map delivery. The platform needed to make those workloads efficient and dependable across regions.
Scale and constraints
Scale
- More than 1 TB processed each day by ETL and ML pipelines.
- Multi-regional infrastructure for geospatial analytics.
- GPU queue with automated regional model evaluation.
Constraints
- Coordinate compute and model selection across regions.
- Reduce latency and infrastructure cost while preserving analytical output.
- Prevent schema issues from repeatedly breaking data and ML pipelines.
Sudhanva’s ownership
Sudhanva built the multi-regional ML infrastructure and data pipelines and architected the GPU queue.
- Multi-regional ML infrastructure.
- ETL and ML pipelines.
- GPU queue and automated A/B testing for regional model selection.
Architecture at a safe level
This public architecture describes system responsibilities and leaves out internal service names and proprietary topology. The relevant boundaries were workload execution, orchestration, data movement, observability, and delivery.
- Designed regional infrastructure around the location and delivery needs of geospatial workloads.
- Automated model evaluation and GPU scheduling, replacing manual regional choices.
- Improved schema handling in the daily data path.
Engineering decisions and tradeoffs
- Multi-regional execution improves proximity and resilience but increases operational coordination.
- GPU capacity and model-selection automation had to be weighed against cloud cost.
Results
- Improved inference efficiency by 75%.
- Reduced map-rendering latency by 50%.
- Reduced pipeline failures caused by schema issues by 30%.
- Saved $500,000 annually in cloud costs.
Reliability and operations
- Schema-focused pipeline improvements reduced a recurring class of failures.
- Automated regional model evaluation reduced manual operational choices.
Transferable lessons
- Data contracts are a reliability concern for ML systems as much as a data-engineering one.
- Regional model delivery should be evaluated with latency, compute efficiency, and cost together.
Technologies
- Geospatial ML
- ETL
- GPU scheduling
- Multi-region cloud infrastructure
- A/B testing
Continue exploring
From the blog
Related writing
CoGeoTIFF Research on Space Tech SaaS Platform at Pixxel
Research notes on Cloud Optimized GeoTIFFs at Pixxel: the tile servers that exist, what it takes to build a product on COGs, Sentinel conversion cases, and AWS cost estimates.
#portfolio
Leaving Pixxel
I thought I'd take some time to write and thank Pixxel and everyone I have had the chance to work with.
#career #goodbye