Databricks-based data engineering and analytics